Fermi’s golden rule describes the decay dynamics of unstable quantum systems coupled to a reservoir, and predicts a linear decay in time. Although it arises at relatively short times, the Fermi regime does not take hold in the earliest stages of the quantum dynamics. The standard criterion in the literature for the onset time of the Fermi regime is t F ∼ 1/Δ ω , with Δ ω the frequency interval around the resonant transition frequency ω 0 of the system, over which the coupling to the reservoir does not vary appreciably. In this work, this criterion is shown to be inappropriate in general for broadband reservoirs, where the reservoir coupling spectrum takes the form R ( ω ) ∝ ω η , and for which it is found that for η > 1, the onset time of the Fermi regime is given by t F ∝ ( ω X / ω 0 ) η −1 × 1/ ω 0 where ω X is the high-frequency cutoff of the reservoir. Therefore, the onset of the Fermi regime can take place at times orders of magnitude larger than those predicted by the standard criterion. This phenomenon is shown to be related to the excitation of the off-resonant frequencies of the reservoir at short times. For broadband reservoirs with η ≤ 1, and for narrowband reservoirs, it is shown that the standard criterion is correct.