We introduce a moment map picture for holomorphic string algebroids where the Hamiltonian gauge action is described by means of Morita equivalences, as suggested by higher gauge theory. The zero locus of our moment map is given by the solutions of the Calabi system, a coupled system of equations which provides a unifying framework for the classical Calabi problem and the Hull-Strominger system. Our main results are concerned with the geometry of the moduli space of solutions, and assume a technical condition which is fulfilled in examples. We prove that the moduli space carries a pseudo-Kähler metric with Kähler potential given by the dilaton functional, a topological formula for the metric, and an infinitesimal Donaldson-Uhlenbeck-Yau type theorem. Finally, we relate our topological formula to a physical prediction for the gravitino mass in order to obtain a new conjectural obstruction for the Hull-Strominger system.