Consider the Langevin process, described by a vector (positions and momenta) in Rd×Rd. Let O be a C2 open bounded and connected set of Rd. Recent works showed the existence of a unique quasi-stationary distribution (QSD) of the Langevin process on the domain D:=O×Rd. In this article, we study the overdamped limit of this QSD, i.e. when the friction coefficient goes to infinity. In particular, we show that the marginal law in position of the overdamped limit is the QSD of the overdamped Langevin process on the domain O.