In this paper, we proposed a novel hierarchical two-pathway autoencoders architecture to transform a local information based on skyline scene representation, into non-linear space. The first pathway is intended for the transformation of the geometric features extracted from the horizon line. The second pathway is applied after the first one to joint the color information under the skyline to the transformed geometric features, and to get the landscape context conceptualization. To evaluate our suggested system, we constructed the SKYLINEScene database containing 2000 images of rural and urban landscapes, with a high degree of diversity. In order to investigate the performance of our HTANN-Skyline, many experiments were carried out using this new database. Our approach shows its robustness in Skyline context conceptualization and enhances the classification rates by 1% compared to the AlexNet architecture; and by more than 10% compared to the hand-crafted approaches based on global and local features. at the Université Lumière Lyon 2, and a member of the LIRIS laboratory, UMR CNRS 5205. His main research activities are devoted to models and tools for image processing, image analysis, shape recognition.