We present a novel method for tracking the left ventricle (LV) in three-dimensional ultrasound data using an hybrid approach combining segmentation and tracking-based clues. This is accomplished by coupling an affine motion model to an existing LV segmentation framework and introducing an energy term that penalizes the deviation to the affine motion estimated using a global Lucas-Kanade algorithm. The hybrid nature of the proposed solution can be seen as using the estimated affine motion to enhance the temporal coherence of the segmented surfaces, by enforcing the tracking of consistent patterns, while the underlying segmentation algorithm allows to locally refine the estimated global motion. The proposed method offers a competitive solution for fast assessment of relevant LV volumetric indices, by combining the robustness of affine motion tracking with the low computational burden of the underlying segmentation algorithm.