We show that, in any space-time dimension, the on-shell (electric) conformal Carrollian scalar can be interpreted as the flat-space limit of the singleton representation of the conformal algebra. In fact, a recently proposed higher-spin algebra for Minkowski spacetime amounts to the Poincaré enveloping algebra on the corresponding module. This higher-spin algebra is a contraction of that entering Vasiliev's equations, which can be constructed analogously from the singleton representation of the conformal algebra. We also show that the higher-spin extension of the Poincaré algebra we consider is a subalgebra of all symmetries of the conformal Carrollian scalar, given by a higher-spin version of the (extended) BMS algebra.