The invention relates to a method for filtering a displacement field between a first image and a second image, a displacement field comprising for each pixel of the first (reference) image a displacement vector to the second image (current). The method comprises a first step of spatio-temporal filtering wherein a weighted sum of neighboring displacement vectors produces, for each pixel of the first image, a filtered displacement vector. The filtering step is remarkable in that a weight in the weighted sum is a trajectory weight, that is a trajectory weight is representative of a trajectory similarity. According to an advantageous characteristic, a trajectory associated to a pixel of the first image comprises a plurality of displacement vectors from the pixel to a plurality of images. According to another advantageous characteristic, a trajectory weight comprises a distance between a trajectory from the pixel and a trajectory from a neighboring pixel. The method also relates to a graphics processing unit and to computer- readable medium for implementing the filtering method.