Residual stress estimation is an important question for structural integrity. Since residual stresses are self-balanced stress fields, a classical way to obtain information on them is to remove a part of the structure, and observe the structure displacement field arising from the stress redistribution. The hole- drilling method is such an approach. In some cases, as for the present one concerning a painted panel of cultural heritage, the hole-drilling method is not suited (a structure with a complex geometry, few tests allowed) but one can take advantage of structural modifications if they are monitored (here, a restoration act). We therefore describe in this article a model updating approach, focusing on the residual stress estimation and not on the material parameter identification. This study couples an optical non-invasive shape measurement (digital image correlation, using a projected speckle pattern on the painted panel, with luminance compensation) and a numerical approach (3D finite elements) for the model updating. The 3D stereo-correlation is used to measure a partial displacement field between three different states of the structure (at three different times of the restoration act). The numerical part concerns stress evaluation, once the model and the experiments are compared using a geometric mapping and a spatial projection of discrete fields. Using modeling and identification, the simulation is used to obtain the residual stresses in the panel, before and after the restoration.