Asphalt mixture performance depends highly on the particle shape. Discrete element method (DEM) has become a highly prevalent approach for testing and reconfiguring particles in asphalt mixtures in recent decades. Nevertheless, most simulation studies simplify particle shapes and ignore irregular morphology features. In this study, morphological characteristics for a large number of particles were analyzed statistically using three-dimensional laser scanning technology. Combining morphology statistics and particle size distribution, numerical samples of asphalt mixtures were generated using Voronoi tessellations. Finally, the model reliability is validated by conducting experiments and simulations for the complex modulus test based on the Contact Dynamics (CD) method. Using this procedure, the aggregate morphology and size distribution can be incorporated in numerical simulations of asphalt mixtures. The modeling method provides a basis for the high-precision simulation of asphalt mixes comprising polyhedral particles, which can be seen as an enriching improvement of the classical procedures.