Since total neoadjuvant treatment achieves almost 30% pathologic complete response, organ preservation has been increasingly debated for good responders after neoadjuvant treatment for patients diagnosed with rectal cancer. Two organ preservation strategies are available: a watch and wait strategy and a local excision strategy including patients with a near clinical complete response. A major issue is the selection of patients according to the initial tumor staging or the response assessment. Despite modern imaging improvement, identifying complete response remains challenging. A better selection could be possible by radiomics analyses, exploiting numerous image features to feed data characterization algorithms. The subsequent step is to include baseline and/or pre-therapeutic MRI, PET-CT, and CT radiomics added to the patients' clinicopathological data, inside machine learning (ML) prediction models, with predictive or prognostic purposes. These models could be further improved by the addition of new biomarkers such as circulating tumor biomarkers, molecular profiling, or pathological immune biomarkers.