This work is dedicated to the grain structure formation in silicon ingots with a particular focus on the crystal structure strain building and its implication in new grain nucleation process. The implied mechanisms are investigated by advanced in situ X-ray imaging techniques during silicon directional solidification. It is shown that the grain structure formation is mainly driven by Σ3 <111> twin nucleation. Grain competition phenomena occurring during the growth process lead to the creation of higher order twin boundaries, localised strained areas and associated crystal structure deformation. On the one hand, it is demonstrated that local strain building can be directly related to the characteristics of the twin boundaries created during silicon growth due to grain competition. On the other hand, space restriction due to competition during growth can be at the origin of local strain building as well. Finally, the accumulation of all these factors generating strain is responsible for spontaneous new grain nucleation. When occurring, both grain nucleation and subsequent grain structure reorganisation contribute to lower the strain in the growing ingot. It is demonstrated as well that the local distribution of the strained areas created during silicon growth is retrieved after cooling down, from melting temperature to room temperature, on top of an additional larger scale deformation of the sample due to the cooling down only.