Smallpox was a highly contagious disease caused by the variola virus. The disease affected millions of people over thousands of years and variola virus ranked as one of the deadliest viruses in human history. The complete eradication of smallpox in 1980, a major triumph in medicine, was achieved through a global vaccination campaign using a less virulent poxvirus, vaccinia virus. Despite this success, the herd immunity established by this campaign has significantly waned, and concerns are rising about the potential reintroduction of variola virus as a biological weapon or the emergence of zoonotic poxviruses. These fears were further fueled in 2022 by a global outbreak of monkeypox virus (mpox), which spread to over 100 countries, thereby boosting interest in developing new vaccines using molecular approaches. However, poxviruses are complex and creating modern vaccines against them is challenging. This review focuses on the structural biology of the six major neutralization determinants on poxviruses (D8, H3, A27, L1, B5, and A33), the localization of epitopes targeted by neutralizing antibodies, and their application in the development of subunit vaccines.