Lymphocytes alternate between phases of individual migration across tissues and phases of clustering during activation and function. The range of lymphocyte motility behaviors and the identity of the factors that govern them remain elusive. To explore this point, we here collected unprecedented statistics pertaining to cell displacements, cell:matrix and cell:cell interactions using a model B cell line as well as primary human B lymphocytes. At low cell density, individual B lymphocytes displayed a high heterogeneity in their speed and diffusivity. Beyond this intrinsic variability, B lymphocytes adapted their motility to the composition of extra-cellular matrix, adopting slow persistent walks over collagen IV and quick Brownian walks over fibronectin. At high cell density, collagen IV favored the self-assembly of B lymphocytes into clusters endowed with collective coordination, while fibronectin stimulated individual motility. We show that this behavioral plasticity is controlled by acto-myosin dependent adhesive and Arp2/3-dependent protrusive actin pools, respectively. Our study reveals the adaptive nature of B lymphocyte motility and group dynamics, which are shaped by an interplay between and cell:matrix and cell:cell interactions.