Many Content Based Image Retrieval systems (CBIRs) have been invented in the last decade. The general mechanism of the search process is very similar for each of these CBIRs, and the calculation of rankings is determined by the comparison of features (low-, mid-, high-level). Nevertheless, all things being equal, the respective realization leads to different results. Knowledge about the internal configuration (used features, weights and metrics) of these systems would be beneficial in many usage scenarios (e.g., by using a query image content sensitive query forwarding strategy or improved result ranking strategies in meta search engines). In this context, the paper presents an approach that supports an automatic detection of the configuration of CBIR systems. We demonstrate that the problem can be partly traced back to an optimization problem and tested several optimization algorithms. The approach has been evaluated based on the ImageCLEF test set and shows good results.