The Double Asteroid Redirection Test (DART, NASA) spacecraft revealed that the primary of the (65803) Didymos near-Earth asteroid (NEA) binary system is not exactly the expected spinning top shape observed for other km-size asteroids. Ground based radar observations predicted that such shape was compatible with the uncertainty along the direction of the asteroid spin axis. Indeed, Didymos shows crater and landslide features, and evidence for boulder motion at low equatorial latitudes. Altogether, the primary seems to have undergone sudden structural failure in its recent history, which may even result in the formation of the secondary. The high eccentricity of Didymos sets its aphelion distance inside the inner main belt, where it spends more than 1/3 of its orbital period and it may undergo many more collisions than in the NEA region. In this work, we investigate the collisional environment of this asteroid and estimate the probability of collision with multi-size potential impactors. We analyze the possibility that such impacts produced the surface features observed on Didymos by comparing collisional intervals with estimated times for surface destabilization by the Yarkovsky-O’Keefe-Radzievskii-Paddack (YORP) effect. We find that collisional effects dominate over potential local or global deformation due to YORP spin up.