Artificial Intelligence in Oncology - Supporting scientific research
UMC Utrecht
In short, Jelle Ruurda's research entails the following:
Every year, 3000 patients are diagnosed with esophageal cancer in the Netherlands. Approximately 25% of them is a candidate for surgical resection of the esophagus. Despite efforts to reduce complications, including performing minimally invasive surgery and dedicated training programs, morbidity and mortality remain substantial. During robot-assisted minimally invasive esophagectomy (RAMIE) procedures, several vital anatomical structures are located within the narrow operating space. The INTRA SURGE-project proposes to advance surgery by developing intelligent surgical guidance based on artificial intelligence to realize computer-aided anatomy recognition to support surgeons intraoperatively, prevent unnecessary tissue injury and increase patient safety.
INTRA SURGE develops artificial intelligence to support surgeons during complex robot-assisted esophageal surgery. By combining advanced machine learning with large surgical video datasets, the project has made considerable progress in real-time recognition of anatomy and surgical phases, even with limited manual annotations. Lightweight and efficient AI models were developed that are suitable for use in the operating room. In addition, stereoscopic surgical video recording was successfully implemented, enabling future patient-specific surgical guidance. These results have been widely published and presented internationally, and form a strong foundation for upcoming clinical validation.
The INTRA SURGE project focuses on enhancing real-time surgical guidance during robot-assisted minimally invasive esophagectomy (RAMIE). By leveraging deep learning, we develop AI-driven models for anatomy recognition, surgical phase identification, and 3D registration. The INTRA SURGE database, containing annotated videos and stereoscopic surgical footage, supports this work. Our preliminary results indicate that self-supervised learning improves model performance, enabling better recognition of anatomical structures and surgical phases. Future steps include refining these AI models for real-time surgical assistance and validating them in both laboratory and clinical settings.