Background: Whereas the role of neoadjuvant radiotherapy in rectal cancer is well-established, the ability to discriminate between radioresistant and radiosensitive tumors before starting treatment is still a crucial unmet need. Here we aimed to develop an in vivo test to directly challenge living cancer cells to radiotherapy, using zebrafish xenografts. Methods: We generated zebrafish xenografts using colorectal cancer cell lines and patient biopsies without in vitro passaging, and developed a fast radiotherapy protocol consisting of a single dose of 25 Gy. As readouts of the impact of radiotherapy we analyzed proliferation, apoptosis, tumor size and DNA damage. Findings: By directly comparing isogenic cells that only differ in the KRAS G13D allele, we show that it is possible to distinguish radiosensitive from radioresistant tumors in zebrafish xenografts, even in polyclonal tumors, in just 4 days. Most importantly, we performed proof-of-concept experiments using primary rectum biopsies, where clinical response to neoadjuvant chemoradiotherapy correlates with induction of apoptosis in their matching zebrafish Patient-Derived Xenografts-Avatars. Interpretation: Our work opens the possibility to predict tumor responses to radiotherapy using the zebrafish Avatar model, sparing valuable therapeutic time and unnecessary toxicity.