DebiAI is an open-source tool designed for data analysis, visualization, as well as evaluation and comparison of machine learning (ML) models. It is intended to be used both at the stage of the project data preparation, and for the evaluation of the ML models performances. It has a rich and user-friendly graphical interface that allows to visualize, analyze, select, edit and annotate data and metadata, as well as for bias detection and contextual evaluation of ML models. The tool relies on a generic data model, making it applicable to any type of ML task: classification, regression, object detection in images and more. It is an open source code distributed under the Apache License, Version 2.0. The code is publicly available (https://github.com/debiai) and further information along with guidelines for the users can be found on its dedicated website (https://debiai.irt-systemx.fr).