Obesity is a chronic and progressive process affecting whole-body energy balance and is associated with comorbidity development. In addition to increased fat mass, obesity induces white adipose tissue (WAT) inflammation and fibrosis, leading to local and systemic metabolic dysfunctions, such as insulin resistance (IR). Accordingly, limiting inflammation or fibrosis deposition may improve IR and glucose homeostasis. Although no targeted therapy yet exists to slow or reverse adipose tissue fibrosis, a number of findings have clarified the underlying cellular and molecular mechanisms. In this review, we highlight adipose tissue remodeling events shown to be associated with fibrosis deposition, with a focus on adipose progenitors involved in obesity-induced healthy as well as unhealthy WAT expansion.