Oligosaccharides are the ubiquitous molecules of life. In order to translate human bioglycosylation into clinical applications, homogeneous samples of oligosaccharides and glycoconjugates can be obtained by chemical, enzymatic or other biological methods for systematic studies. However, the structural complexity and diversity of glycans and their conjugates present a major challenge for the synthesis of such molecules. This review summarizes the chemical synthesis methods of oligosaccharides, the application of oligosaccharides in the field of medicinal chemistry according to their related biological activities, and shows the great prospect of oligosaccharides in the field of pharmaceutical chemistry.