The derivation of the overall behaviour of nonlinear viscoelastic (or rate-dependent elastoplastic) heterogeneous materials requires a linearisation of the constitutive equations around uniform per phase stress (or strain) histories. The resulting Linear Comparison Material (LCM) has to be linear thermoviscoelastic to fully retain the viscoelastic nature of phase interactions. Instead of the exact treatment of this LCM (i.e., correspondence principle and inverse Laplace transforms) as proposed by the “classical” affine formulation, an approximate treatment is proposed here. First considering Maxwellian behaviour, comparisons for a single phase as well as for two-phase materials (with “parallel” and disordered morphologies) show that the “direct inversion method” of Laplace transforms, initially proposed by Schapery (1962), has to be adapted to fit correctly exact responses to creep loading while a more general method is proposed for other loading paths. When applied to nonlinear viscoelastic heterogeneous materials, this approximate inversion method gives rise to a new formulation which is consistent with the classical affine one for the steady-state regimes. In the transient regime, it leads to a significantly more efficient numerical resolution, the LCM associated to the step by step procedure being no more thermoviscoelastic but thermoelastic. Various comparisons for nonlinear viscoelastic polycrystals responses to creep as well as relaxation loadings show that this “quasi-elastic” formulation yields results very close to classical affine ones, even for high contrasts.