Baggage Handling System (BHS) is a complex system that depends on many factors such as quantity of bags, interval of arrivals, barcode misreads, early bags and late bags, traveling time and security check. The main role of BHS is to sort and transport all transfer and check-in bags to each destination, that is to the right plane, at the right time. The airport in charge of BHS has to minimize the number of failed bags in the system. A failed bag is defined to be a bag that is not delivered in time for the assigned flight. Colored Petri Nets (CPNs) extend the classical Petri net formalism with data, time, and hierarchy. These extensions makes it possible to model complex processes like BHS. Furthermore, CPNs are supported by CPN Tool, a powerful toolset that allows the design and analysis of complex processes. This paper deals with modeling and simulation of BHS using Colored Petri Nets. Simulation results show that one of the main causes of the failed bags is the Manual Scanning process, especially the percentage of barcode misread.