Elephant tusks are composed of dentin or ivory, a hierarchical and composite biological material made of mineralized collagen fibers (MCF). The specific arrangement of the MCF is believed to be responsible for the optical and mechanical properties of the tusks. Especially the MCF organization likely contributes to the formation of the bright and dark checkerboard pattern observed on polished sections of tusks (Schreger pattern). Yet, the precise structural origin of this optical motif is still controversial. We hereby address this issue using complementary analytical methods (small and wide angle X-ray scattering, cross-polarized light microscopy and scanning electron microscopy) on elephant ivory samples and show that MCF orientation in ivory varies from the outer to the inner part of the tusk. An external cohesive layer of MCF with fiber direction perpendicular to the tusk axis wraps the mid-dentin region, where the MCF are oriented mainly along the tusk axis and arranged in a plywood-like structure with fiber orientations oscillating in a narrow angular range. This particular oscillating-plywood structure of the MCF and the birefringent properties of the collagen fibers, likely contribute to the emergence of the Schreger pattern, one of the most intriguing macroscopic optical patterns observed in mineralized tissues and of great importance for authentication issues in archeology and forensic sciences.