Hemp concretes are the most widely used biobased concretes in France. However, their growth is still limited by the lack of knowledge and high variability of the performances of biobased concretes, especially for their mechanical properties. These results are related to interactions between the mineral binder and plant compounds that modify the hydration of the cement. In this work, the interactions between cement and eight types of hemp shiv, and a flax shiv are studied by isothermal calorimetry. The setting delays observed in the presence of plants are interpreted by analyzing the molecules extracted from these plants in water. A link can be observed between the setting delay and the coloration of the extract solutions or their concentration in reducing sugars and in polyphenols. These results constitute a basis in the objective to define an indicator enabling to predict the compatibility between plants and mineral binders.