This paper presents the results of a life cycle assessment undertaken to compare the potential environmental impacts associated with the use of asphalt surface mixtures produced with polymer modified bitumen with those of a conventional asphalt surface mixture. Seven types of hot mix asphalt mixtures to be used in the surface course are compared, among which one produced with virgin materials and conventional binder, which is used as a reference, and six alternative mixtures containing a bituminous binder modified with different percentages of waste nitrile rubber from shoe sole and Ethylene-Vinyl-Acetate polymer. The ILCD impact assessment method at midpoint level was adopted to assess the environmental performance of the wearing course of a French pavement structure over a 30-year project analysis period considering the following pavement life cycle phases: (1) extraction of raw materials, modification of the bituminous binder and mixtures production; (2) transportation of materials, and; (3) construction and maintenance and rehabilitation.