The optical response of a matter excitation embedded in nanophotonic devices is commonly described by the Drude-Lorentz model. Here, we demonstrate that this widely used approach fails in the case where quantum-confined plasmons of a two-dimensional electron gas interact strongly with optical phonons. We propose a new quantum model which contains the semiclassical Drude-Lorentz one for simple electronic potentials, but predicts very different results in symmetry-broken potentials. We unveil a new mechanism for the oscillator strength transfer between bright phonon-polariton and dark plasmon modes, enabling thus new quantum degrees of freedom for designing the optical response of nanostructures.