Rationale: The tumor microenvironment (TME) and its multifaceted interactions with cancer cells are major targets for cancer treatment. Single-cell technologies have brought major insights into the TME, but the resulting complexity often precludes conclusions on function. Methods: We combined single-cell RNA sequencing and spatial transcriptomic data to explore the relationship between different cancer-associated fibroblast (CAF) populations and immune cell exclusion in breast tumors. The significance of the findings was then evaluated in a cohort of tumors (N=75) from breast cancer patients using immunohistochemistry analysis. Results: Our data show for the first time the degree of spatial organization of different CAF populations in breast cancer. We found that IL-iCAFs, Detox-iCAFs, and IFNγ-iCAFs tended to cluster together, while Wound-myCAFs, TGFβ-myCAFs, and ECM-myCAFs formed another group that overlapped with elevated TGF-β signaling. Differential gene expression analysis of areas with CD8+ T-cell infiltration/exclusion within the TGF-β signaling-rich zones identified elastin microfibrillar interface protein 1 (EMILIN1) as a top modulated gene. EMILIN1, a TGF-β inhibitor, was upregulated in IFNγ-iCAFs directly modulating TGFβ immunosuppressive function. Histological analysis of 75 breast cancer samples confirmed that high EMILIN1 expression in the tumor margins was related to high CD8+ T-cell infiltration, consistent with our spatial gene expression analysis. High EMILIN1 expression was also associated with better prognosis of patients with breast cancer, underscoring its functional significance for the recruitment of cytotoxic T cells into the tumor area. Conclusion: Our data show that correlating TGF-β signaling to a CAF subpopulation is not enough because proteins with TGF-β-modulating activity originating from other CAF subpopulations can alter its activity. Therefore, therapeutic targeting should remain focused on biological processes rather than on specific CAF subtypes.