In biological dosimetry, a radiation dose is estimated using the average number of chromosomal aberration per peripheral blood lymphocytes. To achieve an adequate precision in the estimation of this average, hundreds of cells must be analyzed in 2D microscopy images. Currently, this analysis is performed manually, as conventional computer vision techniques struggle with the wide variety of shapes showcased by chromosomes. The false discovery rate of current automated detection systems is high and variable, depending on small variations in data quality (chromosome spread, illumination variations ...), which makes using it in a fully automated fashion impossible. Automating chromosomal aberration is needed to reduce diagnosis time. Furthermore, an automated system can process more images, which improves confidence intervals around the estimated radiation dose. We build an object detection model to automate chromosomal aberration detection using recent advances in deep convolutional neural networks and statistical learning. We formulated the problem of rare aberration detection as a heatmap regression problem requiring the minimization of a sparsitypromoting loss to reduce the false alarm rate. Our Unet-based approach is analoguous to a one-stage object detector, and keeps the number of hyperparameters to a minimum. Finally, we demonstrate large performance improvements using an ensemble of checkpoints collected during a single run of training. A PCA-based strategy is used to provide cues for interpretation of our deep neural networkbased model. The methodology is demonstrated on real, large, and challenging datasets depicting rare chromosomal aberrations and is favorably compared to a reference dosimetry technique.