Sickle cell disease (SCD) is a hereditary blood disorder in which the oxygen‐carrying hemoglobin molecule in red blood cells is abnormal. SCD patients are at increased risks for strokes and neurocognitive deficit, even though neurovascular screening and treatments have lowered the rate of overt strokes. Tract‐specific analysis (TSA) is a statistical method to evaluate microstructural WM damage in neurodegenerative disorders, using diffusion tensor imaging (DTI). We utilized TSA and compared 11 major brain WM tracts between SCD patients with no history of overt stroke, anemic controls, and healthy controls. We additionally examined the relationship between the most commonly used DTI metric of WM tracts and neurocognitive performance in the SCD patients and healthy controls. Disruption of WM microstructure orientation‐dependent metrics for the SCD patients was found in the genu of the corpus callosum (CC), cortico‐spinal tract, inferior fronto‐occipital fasciculus, right inferior longitudinal fasciculus, superior longitudinal fasciculus, and left uncinate fasciculus. Neurocognitive performance indicated slower processing speed and lower response inhibition skills in SCD patients compared to controls. TSA abnormalities in the CC were significantly associated with measures of processing speed, working memory, and executive functions. Decreased DTI‐derived metrics were observed on six tracts in chronically anemic patients, regardless of anemia subtype, while two tracks with decreased measures were unique to SCD patients. Patients with WMHs had more significant FA abnormalities. Decreased FA values in the CC significantly correlated with all nine neurocognitive tests, suggesting a critical importance for CC in core neurocognitive processes.