We consider theoretically and numerically disordered elastic networks with annealed or quenched connectivity matrices (CMs) focusing on the quenched shear stresses induced by the spontaneous symmetry breaking between different CMs. By rewriting the stress-fluctuation formalism relation for the shear modulus it is argued that theses quenched stresses give an important contribution $\mu_1$ to the finite shear modulus $\mu_q=\mu_1+\mu_a$ for quenched CMs. $\mu_a$ is a simple average over all states and CMs which for equilibrium distributions of CMs is equivalent to the shear modulus of annealed networks. Interestingly, $\mu_a$ may be strongly negative for out-of-equilibrium distributions as shown by considering a temperature quench and a scalar active two-temperature model.