We aimed to explore the relationship between comorbidities and the structural progression in symptomatic knee and/or hip osteoarthritis (OA) patients. We analyzed the 5-year outcome of non-obese participants (body mass index (BMI) < 30 kg/m2) from the KHOALA cohort having symptomatic hip and/or knee OA (Kellgren and Lawrence (KL) ≥ 2). The primary endpoint was radiological progression, defined as ΔKL ≥ 1 of the target joint at 5 years. The secondary outcome was the incidence of total knee or hip replacement over 5 years. Dichotomous logistic regression models assessed the relationship of comorbidities with KL progression and joint replacement while controlling for gender, age and BMI. Data from 384 non-obese participants were analyzed, 151 with hip OA and 254 with knee OA. At 5 years, cardiovascular diseases (CVD) were significantly associated with the 5-year KL change in both knee (OR = 2.56 (1.14–5.78), p = 0.02) and hip OA (OR = 3.45 (1.06–11.17), p = 0.04). No significant relationship was found between any type of comorbidities and knee or hip arthroplasty. This 5-year association between CVD and radiological progression of knee and hip OA in non-obese participants argue for an integrated management of CVD in knee and hip OA non-obese patients.