The activation of phagocytic cells is a hallmark of many neurological diseases. Imaging them in their 3-dimensional cerebral environment over time is crucial to better understand their role in disease pathogenesis and to monitor their potential therapeutic effects. Phagocytic cells have the ability to internalize metal-based contrast agents both in vitro and in vivo and can thus be tracked by magnetic resonance imaging (MRI) or computed tomography (CT). In this review article, we summarize the different labelling strategies, contrast agents, and in vivo imaging modalities that can be used to monitor cells with phagocytic activity in the central nervous system using MRI and CT, with a focus on clinical applications. Metal-based nanoparticle contrast agents such as gadolinium, gold and iron are ideal candidates for these applications as they have favourable magnetic and/or radiopaque properties and can be fine-tuned for optimal uptake by phagocytic cells. However, they also come with downsides due to their potential toxicity, especially in the brain where they might accumulate. We therefore conclude our review by discussing the pitfalls, safety and potential for clinical translation of these metal-based neuroimaging techniques. Early results in patients with neuropathologies such as multiple sclerosis, stroke, trauma, cerebral aneurysm and glioblastoma are promising. If the challenges represented by safety issues are overcome, phagocytic cells imaging will be a very valuable tool for studying and understanding the inflammatory response and evaluating treatments that aim at mitigating this response in patients with neurological diseases.