Research in the area of 3-D city modeling from remote sensed data greatly developed in recent years with an emphasis on systems dealing with the detection and representation of man-made objects, such as buildings and streets. While these systems produce accurate representations of urban environments, they ignore information about the vegetation component of a city. This paper presents a complete image analysis system which, from high-resolution color infrared (CIR) digital images, and a Digital Surface Model (DSM), extracts, segments, and classifies vegetation in high density urban areas, with very high reliability. The process starts with the extraction of all vegetation areas using a supervised classification system based on a Support Vector Machines (SVM) classifier. The result of this first step is further on used to separate trees from lawns using texture criteria computed on the DSM. Tree crown borders are identified through a robust region growing algorithm based on tree-shape criteria. A SVM classifier gives the species class for each tree-region previously identified. This classification is used to enhance the appearance of 3-D city models by a realistic representation of vegetation according to the vegetation land use, shape and tree species.