Sarcomeres are the basic contractile units within cardiac myocytes, and the collective shortening of sarcomeres aligned along myofibrils generates the force driving the heartbeat. The alignment of the individual sarcomeres is important for proper force generation, and misaligned sarcomeres are associated with diseases, including cardiomyopathies and COVID-19. The actin bundling protein, α-actinin-2, localizes to the ‘Z-Bodies” of sarcomere precursors and the ‘Z-Lines’ of sarcomeres, and has been used previously to assess sarcomere assembly and maintenance. Previous measurements of α-actinin-2 organization have been largely accomplished manually, which is time-consuming and has hampered research progress. Here, we introduce sarcApp, an image analysis tool that quantifies several components of the cardiac sarcomere and their alignment in muscle cells and tissue. We first developed sarcApp to utilize deep learning-based segmentation and real space quantification to measure α-actinin-2 structures and determine the organization of both precursors and sarcomeres/myofibrils. We then expanded sarcApp to analyze ‘M-Lines’ using the localization of myomesin and a protein that connects the Z-Lines to the M-Line (titin). sarcApp produces 33 distinct measurements per cell and 24 per myofibril that allow for precise quantification of changes in sarcomeres, myofibrils, and their precursors. We validated this system with perturbations to sarcomere assembly. We found perturbations that affected Z-Lines and M-Lines differently, suggesting that they may be regulated independently during sarcomere assembly.