Abstract The left ventral occipito-temporal cortex (left-vOT) plays a key role in reading. Several studies have also reported its activation during speech processing, suggesting that it may play a role beyond written word recognition. Here, we adopt a graph theoretical analysis to investigate the functional role of this area in the whole-brain network while participants processed spoken sentences in different tasks. We find that its role and interactions with other areas changes in an adaptive manner. In a low-level speech perception task, the left-vOT is part of the visual network and acts as a connector that supports the communication with other cognitive systems. When speech comprehension is required, the area becomes a connector within the sensorimotor-auditory network typically recruited during speech processing. However, when comprehension is compromised due to degradation of speech input, the area disengages from the sensorimotor-auditory network. It becomes part of the visual network again and turns from connector into a simple peripheral node. These varying connectivity patterns are coherent with the Interactive Account considering the left-vOT as a convergent zone with multiple functions and interaction patterns that depend on task demands and the nature of sensory input.