The intermittent damage evolution preceding the failure of heterogeneous brittle solids is well described by scaling laws. In deciphering its origins, failure is routinely interpreted as a critical transition. However at odds with expectations of universality, a large scatter in the value of the scaling exponents is reported during acoustic emission experiments. Here we numerically examine the precursory damage activity to reconcile the experimental observations with critical phenomena framework. Along with the strength of disorder, we consider an additional parameter that describes the progressive damageability of material elements at mesoscopic scale. This hardening behavior encapsulates the micro-fracturing processes taking place at lower length scales. We find that damage hardening can not only delay the final failure, but also affect the preceding damage accumulation. When hardening is low, the precursory activity is strongly influenced by the strength of the disorder and is reminiscent of damage percolation. On the contrary, for large hardening, long-range elastic interactions prevail over disorder, ensuring a rather homogeneous evolution of the damage field in the material. The power-law statistics of the damage bursts is robust to the strength of the disorder, and is reminiscent of the collective avalanche dynamics of elastic interfaces near the depinning transition. The existence of these two distinct universality classes also manifests as different values of the scaling exponent characterizing the divergence of the precursor size on approaching failure. Our finding sheds new light on the connection between the level of quasi-brittleness of materials and the statistical features of the failure precursors. Finally, it also provides a more complete description of the acoustic precursors and thus paves the way for quantitative techniques of damage monitoring of structures-in-service.