The aim of this work is to build a user profile according to his own perception of colors for image retrieving. Images are being processed relying on a standard or initial set of parameters using the fuzzy set theory and the HLS color space (Hue, Lightness, and Saturation). We developed a dynamic construction of the user profile, which will increase his satisfaction by being more personalized and accommodated to his particular needs. We suggest two methods to define the perception and transform it into a profile; the first method is achieved by querying the user and getting answers, which will guide through the process of implementation of the profile; the second method is achieved by comparing different subjects and ending up by an appropriate aggregation. We also present a method that will recalculate the amount of colors in the image based on another set of parameters, so the colorimetric profile of the image is being modified accordingly. Avoiding the repetition of the process at the pixel level is the main target of this phase, because reprocessing each image is time consuming and turned to be not feasible.