Morphological hierarchies now form a well-established framework for (still) image modeling and processing. However , their extension to time-related data remains largely unexplored. In this paper, we address such a topic and show how to analyze image sequences with tree-based representations. To do so, we distinguish between three kinds of models, namely spatial, temporal and spatial-temporal hierarchies. For each of them, we review different strategies to build the hierarchy from an image sequence. We also propose some algorithms to update such trees when new images are appended to the series and we compared the time complexity with tree building from scratch. We illustrate our findings with the max and min-tree structures built on grayscale data provided by Satellite Image Time Series that are gathering a growing interest in Earth Observation. Besides, we provide a comparative study for different hierarchies with classification experiments.