Soil trace metal concentrations (e.g., cadmium, copper, lead, zinc) in vegetable gardens have often been observed as exceeding the geochemical background levels. These metals are a threat both to soil and plant functioning and to human health through consumption of contaminated vegetables. We used a mass balance-based model to predict the four metal (Cd, Cu, Pb, Zn) concentrations in soils after a century’s cultivation for 104 urban vegetable gardens, located in three French metropolises, Nancy, Nantes, and Marseille, based on a survey of gardening practices. If current gardening practices are maintained, an increase in soil Cd (35% on average), Cu (183%), and Zn (27%) contents should occur after a century. Soil Pb concentration should not vary consistently. Organic amendments are the major source of Cd, Pb, and Zn, followed by chemical fertilizer while fungicide application is the major source of Cu. Cessation of chemical fertilizer use would only slightly reduce the accumulation of the four metals. The solubility of the four metals would decrease significantly after a century, when pH increases by one unit. A liming practice of acidic soils should therefore be a feasible way to prevent any increase in the metal mobility and bioavailability.