We consider a homogenization problem for the diffusion equation $-\operatorname{div}\left(a_{\varepsilon} \nabla u_{\varepsilon} \right) = f$ when the coefficient $a_{\varepsilon}$ is a non-local perturbation of a periodic coefficient. The perturbation does not vanish but becomes rare at infinity in a sense made precise in the text. We prove the existence of a corrector, identify the homogenized limit and study the convergence rates of $u_{\varepsilon}$ to its homogenized limit.