Abstract It has been proposed that the human amygdala may not only encode the emotional value of sensory events, but more generally mediate the appraisal of their relevance for the individual’s goals, including relevance for action or task-based needs. However, emotional and non-emotional/action-relevance might drive amygdala activity through distinct neural signals, and the relative timing of both kinds of responses remains undetermined. Here, we recorded intracranial event-related potentials from nine amygdalae of patients undergoing epilepsy surgery, while they performed variants of a Go/NoGo task with faces and abstract shapes, where emotion- and action-relevance were orthogonally manipulated. Our results revealed early amygdala responses to emotion facial expressions starting ~ 130 ms after stimulus-onset. Importantly, the amygdala responded to action-relevance not only with face stimuli but also with abstract shapes (squares), and these relevance effects consistently occurred in later time-windows (starting ~ 220 ms) for both faces and squares. A similar dissociation was observed in gamma activity. Furthermore, whereas emotional responses habituated over time, the action-relevance effect increased during the course of the experiment, suggesting progressive learning based on the task needs. Our results support the hypothesis that the human amygdala mediates a broader relevance appraisal function, with the processing of emotion-relevance preceding temporally that of action-relevance.