Arable weeds are key organisms for biodiversity maintenance and ecosystem service provision in agroecosystems. Disentangling the drivers of weed diversity is critical to counteract the global decline of farmland biodiversity. Even if distinct scale-dependent processes were alternatively proposed, no general framework unifying the multi-scale drivers of weed dynamics has yet emerged. Here, we investigate the joint effects of field- and landscape-scale processes on weed assemblages in 444 arable fields. First, field margins sheltered greater weed diversity than field core, evidencing their role as biodiversity refugia. Second, community similarity between field core and margin decreased with the distance to margin, highlighting a major role of local dispersal. Third, weed diversity at field margins increased with organic field cover in the landscape, pointing out massive regional dispersal. Fourth, while both local and landscape dispersal explained up to 41% of field core weed diversity, crop type strongly modulated their strength, depicting an intense filtering effect by agricultural management. This study sheds new light on the complex multi-scale interactions shaping weed diversity, field margins playing a key role by strengthening regional dispersal and sustaining local dispersal. Land-sharing strategies improving habitat heterogeneity both locally and regionally should largely promote agroecosystem multifunctionality and sustainability.