To assess the factors associated with a poor prognosis for a cumulative IVF live birth rate (LBR) in women with stage III and IV endometriosis according to the revised classification of the American Fertility Society (rAFS). A retrospective cohort study was conducted between January 1, 2010, and December 31, 2014, in our Reproductive Medicine Center. We analyzed different factors associated with a poor prognosis for a cumulative IVF LBR in women with rAFS stage III and IV endometriosis. A total of 101 patients were included, representing 232 IVF-ICSI cycles and 212 embryo transfers. The primary endpoint was the cumulative LBR per cycle and per patient. The cumulative LBR per cycle was 14.7% (n = 34) and that per patient was 31.7% (n = 32). The cumulative LBR was significantly decreased by active smoking [adjOR = 3.4, 95% CI (1.12-10.60), p = 0.031], poor ovarian response (POR) according to the Bologna criteria [adjOR = 11.5, 95% CI (1.37-96.83), p = 0.024], and rAFS stage IV [adjOR = 3.2, 95% CI (1.13-8.95), p = 0.024]. The cumulative LBR per women was 59.4% without factors associated with a poor prognosis and 25.6% in the case of one factor, and it decreased to 7.7% in the case of two or three factors (p < 0.001). Active smoking, POR according to the Bologna criteria, and rAFS stage IV endometriosis had a negative impact on the IVF-ICSI cumulative LBR for women with rAFS stage III and IV endometriosis. Because smoking dramatically decreases the LBR with endometriosis, stopping smoking before IVF-ICSI should be strongly advised.