Sophorolipids are well-known scaled-up microbial glycolipid biosurfactants with a strong potential for commercialization due to their biological origin and mildness in contact with the skin and the environment compared to classical surfactants. However, their association properties in water are still poorly understood, they cannot be predicted and their behavior in solution challenges half a century of knowledge generated in the field of surfactant science. By studying forty different types of sophorolipids and sophorosides in water using small angle X-ray scattering, and optical and cryogenic transmission electron microscopy, this work provides better understanding of their structure-property relationship and identifies which chemical groups in their molecular structure have a critical influence on their self-assembly properties. Structural features like the number of sugar headgroups, acetylation, end-chain functional group, (un)saturation, lactonization and length of chain are adjusted to both rationalize their impact and understand their effect on self-assembly. The number of sugar groups, pH, (un)saturation and lactonization were found to have a critical impact on sophorolipid self-assembly. The chemical nature of the end-chain functional group and chain length were also found to have a possibly critical impact, depending on the specific type of chemical function (COOH and long chains are critical). Mono- and diacetylation, as well as the position of sophorose in the fatty acid (ω, ω-1), are not critical, i.e., they did not significantly influence sophorolipid self-assembly.