The modulation of plasma membrane proteins involved in the communication with the immune system is a general mechanism developed by viruses to escape the immune response. Most of the studied examples have focused on viral proteins that missort cellular proteins during their biosynthesis. However, an increasing number of examples show that the down-modulation can also be achieved after membrane delivery by targeting into the endocytic pathway. For both human immunodeficiency virus (HIV) and Kaposi sarcoma-associated herpesvirus (KSHV), the proteins required for this process are identified, Nef and K3/K5 respectively. The extensive studies in this field have shown that the mechanisms by which these proteins "parasite" the endocytic pathway are completely different. Nef directly interacts with components of the cellular machinery involved in the vesicular transport between the endocytic compartments, mainly the clathrin adaptor complexes (AP), inducing the misrouting of numerous cellular proteins, including CD4, MHC-I, LIGHT, DC-SIGN, CD28 and MHC-II to the endosomal degradation compartment or the trans Golgi-network. The K3 and K5 proteins from KSHV act by inducing the ubiquitylation of the target proteins, such as CMH-I and B7.2, triggering their internalization and subsequent degradation by the highly conserved Tsg101/vps23 ubiquitin-dependent endosomal pathway. While these findings show that the strategies used by viruses to target cellular proteins to the endocytic pathway are extremely diverse, additional investigations are needed for the complete understanding of the specific roles of Nef and K3/K5 in the physiopathology of HIV and KSHV infections, respectively. In addition, these viral factors represent valuable tools to study the pathway they are perturbing.