Within human problem solving, the propensity to use a familiar approach, rather than switch to a more efficient alternative is pervasive. This susceptibility to ‘cognitive set’ prevents optimization by biasing response patterns toward known solutions. In a recent study, which utilized nonverbal touch screen task, baboons exhibited a striking ability to deviate from their learned strategy to utilize a more efficient shortcut. Humans, on the other hand, displayed the opposite response pattern and almost exclusively used a less efficient, but familiar, response. In the current study, we sought to further explore variation in susceptibility to cognitive set within the primate lineage by conducting the LS-DS task with ten chimpanzees (Pan troglodytes). Using multilevel multinomial modeling, we found that chimpanzees’ shortcut-use was intermediate to baboons’ and humans’. However, unlike either baboons or humans, there was pronounced inter- and intra-individual variability in chimpanzees’ shortcut-use. Additionally, a subset of chimpanzees employed a unique solution, wherein they switched strategies mid-trial. Further, we found that chimpanzees did not exhibit switch costs when switching between the learned strategy and the shortcut, but humans did. We propose that differences in abstract rule encoding may underlie differences in susceptibility to cognitive set on the LS-DS task within the primate lineage.