Age-related macular degeneration (AMD) is characterized by a central vision loss. Here, we investigated the ability of AMD patients to process the spatial frequency content of scenes in their residual vision, depending of the luminance contrast level. AMD patients and normally-sighted elderly participants (controls) performed a categorization task involving large scenes (outdoors vs. indoors) filtered in low spatial frequencies (LSF), high spatial frequencies (HSF), and non-filtered scenes (NF). Luminance contrast of scenes was equalized between stimuli using a root-mean square (RMS) contrast normalization. In Experiment 1, we applied an RMS contrast of 0.1 (for luminance values between 0 and 1), a value situated between the mean contrast of LSF and HSF scenes in natural conditions. In Experiment 2, we applied an RMS contrast of 0.3, corresponding to the mean contrast of HSF scenes in natural conditions. In Experiment 3, we manipulated four levels of linearly-increasing RMS contrasts (0.05, 0.10, 0.15, and 0.20) for HSF scenes only. Compared to controls, AMD patients gave more non-responses in the categorization of HSF than NF or LSF scenes, irrespective of the contrast level of scenes. Performances improved as contrast increased in HSF scenes. Controls were not differentially affected by the spatial frequency content of scenes. Overall, results suggest that LSF processing is well preserved in AMD patients and allows efficient scene categorization in their parafoveal residual vision. The HSF processing deficit could be partially restored by enhancing luminance contrast.