In this chapter, the authors present the key stages of the reconstruction process, focusing on certain difficult points. They consider the analysis of color images with the aim of automatically selecting the playing surface. The region of interest (ROI) of a sporting scene is, naturally, the playing area. This playing area may often be characterized both as a region with a relatively uniform shade and as the largest quasi-connected component of the image under consideration. They concern the extraction of markings on the playing field using Hough transforms. For sporting scenes, pitch markings are often made up of straight and ellipse arc segments, and the Hough transform is ideally suited to characterizing these simple geometric primitives. They consider the matching of primitives extracted from images with those used in the model of the scene.