Ferromagnetic transition has generally been considered to involve only an ordering of magnetic moment with no change in the host crystal structure or symmetry, as evidenced by a wealth of crystal structure data from conventional X-ray diffractometry (XRD). However, the existence of magnetostriction in all known ferromagnetic systems indicates that the magnetic moment is coupled to the crystal lattice; hence there is a possibility that magnetic ordering may cause a change in crystal structure. With the development of high-resolution synchrotron XRD, more and more magnetic transitions have been found to be accompanied by simultaneous structural changes. In this article, we review our recent progress in understand- ing the structural change at a ferromagnetic transition, including synchrotron XRD evidence of structural changes at the ferromagnetic transition, a phenomenological theory of crystal structure changes accompanying ferromagnetic transitions, new insight into magnetic morphotropic phase boundaries (MPB) and so on. Two intriguing implications of non-centric symmetry in the ferromagnetic phase and the first-order nature of ferromagnetic transition are also discussed here. In short, this review is intended to give a self-consistent and logical account of structural change occurring simultaneously with a ferromagnetic transition, which may provide new insight for developing highly magneto-responsive materials.