Interplay between voltage induced magnetic anisotropy transition and voltage induced atomic diffusion is studied in epitaxial V/Fe (0.7 nm)/ MgO/ Fe(5 nm)/Co/Au magnetic tunnel junction where thin Fe soft electrode has in-plane or out-of-plane anisotropy depending on the sign of the bias voltage. We investigate the origin of the slow resistance variation occurring when switching bias voltage in opposite polarity. We demonstrate that the time to reach resistance stability after voltage switching is reduced when increasing the voltage amplitude or the temperature. A single energy barrier of about 0.2 eV height is deduced from temperature dependence. Finally, we demonstrate that the resistance change is not correlated to a change in soft electrode anisotropy. This conclusion contrasts with observations recently reported on analogous systems.