Rare species are crucial components of the highly diverse soil microbial pool and over-proportionally contribute to the soil functions. However, much remains unknown about their assembling rules. The biogeographic patterns and species aggregations of the rare bacterial biosphere were assessed using 140 soil samples from a gradient of 2000 km across the main tea-producing areas in China. About 96% OTUs with ~40% sequences were classified as rare taxa. The rare bacterial communities were significantly affected by geographical regions and showed distance-decay effects, indicating that the rare bacteria are not cosmopolitan, they displayed a pattern of limited dispersal and were restricted to certain sites. Variation partitioning analysis (VPA) revealed that environmental variation and spatial factors explained 12.5% and 6.4%, respectively, of the variance in rare bacterial community. The Mantel and partial Mantel tests also showed that the environmental factors had stronger (~3 times) impacts than spatial factors. The null model showed that deterministic processes contributed more than stochastic processes in rare bacterial assembly (75% vs. 25%). There is likely an enrichment in ecological functions within the rare biosphere, considering this high contribution of deterministic processes in the assembly. In addition, the assembly of rare taxa was found to be mainly driven by soil pH. Overall, this study revealed that rare bacteria were not cosmopolitan, and their assembly was more driven by deterministic processes. These findings provided a new comprehensive understanding of rare bacterial biogeographic patterns and assembly rules.