Purpose: (Chemo)-radiotherapy (RT) is the gold standard treatment for patients with locally advanced lung cancer non accessible for surgery. However, current toxicity prediction models rely on clinical and dose volume histograms (DVHs) and remain unsufficient. The goal of this work is to investigate the added predictive value of the radiomics approach applied to dose maps regarding acute and late toxicities in both the lungs and esophagus. Methods: Acute and late toxicities scored using the CTCAE v4.0 were retrospectively collected on patients treated with RT in our institution. Radiomic features were extracted from 3D dose maps considering Gy values as grey-levels in images. DVH and usual clinical factors were also considered. Three toxicity prediction models (clinical only, clinical + DVH and combined, i.e., including clinical + DVH + radiomics) were incrementally trained using a neural network on 70% of the patients for prediction of grade ≥2 acute and late pulmonary toxicities (APT/LPT) and grade ≥2 acute esophageal toxicities (AET). After bootstrapping (n = 1000), optimal cut-off values were determined based on the Youden Index. The trained models were then evaluated in the remaining 30% of patients using balanced accuracy (BAcc). Results: 167 patients were treated from 2015 to 2018: 78% non small-cell lung cancers, 14% small-cell lung cancers and 8% other histology with a median age at treatment of 66 years. Respectively, 22.2%, 16.8% and 30.0% experienced APT, LPT and AET. In the training set (n = 117), the corresponding BAcc for clinical only/clinical + DVH/combined were 0.68/0.79/0.92, 0.66/0.77/0.87 and 0.68/0.73/0.84. In the testing evaluation (n = 50), these trained models obtained a corresponding BAcc of 0.69/0.69/0.92, 0.76/0.80/0.89 and 0.58/0.73/0.72. Conclusion: In patients with a lung cancer treated with RT, radiomic features extracted from 3D dose maps seem to surpass usual models based on clinical factors and DVHs for the prediction of APT and LPT.