EndoMapper dataset of complete calibrated endoscopy procedures
Authors:
Pablo Azagra,
Carlos Sostres,
Ángel Ferrandez,
Luis Riazuelo,
Clara Tomasini,
Oscar León Barbed,
Javier Morlana,
David Recasens,
Victor M. Batlle,
Juan J. Gómez-Rodríguez,
Richard Elvira,
Julia López,
Cristina Oriol,
Javier Civera,
Juan D. Tardós,
Ana Cristina Murillo,
Angel Lanas,
José M. M. Montiel
Abstract:
Computer-assisted systems are becoming broadly used in medicine. In endoscopy, most research focuses on the automatic detection of polyps or other pathologies, but localization and navigation of the endoscope are completely performed manually by physicians. To broaden this research and bring spatial Artificial Intelligence to endoscopies, data from complete procedures is needed. This paper introdu…
▽ More
Computer-assisted systems are becoming broadly used in medicine. In endoscopy, most research focuses on the automatic detection of polyps or other pathologies, but localization and navigation of the endoscope are completely performed manually by physicians. To broaden this research and bring spatial Artificial Intelligence to endoscopies, data from complete procedures is needed. This paper introduces the Endomapper dataset, the first collection of complete endoscopy sequences acquired during regular medical practice, making secondary use of medical data. Its main purpose is to facilitate the development and evaluation of Visual Simultaneous Localization and Mapping (VSLAM) methods in real endoscopy data. The dataset contains more than 24 hours of video. It is the first endoscopic dataset that includes endoscope calibration as well as the original calibration videos. Meta-data and annotations associated with the dataset vary from the anatomical landmarks, procedure labeling, segmentations, reconstructions, simulated sequences with ground truth and same patient procedures. The software used in this paper is publicly available.
△ Less
Submitted 10 October, 2023; v1 submitted 29 April, 2022;
originally announced April 2022.
SuperPoint features in endoscopy
Authors:
O. L. Barbed,
F. Chadebecq,
J. Morlana,
J. M. Martínez-Montiel,
A. C. Murillo
Abstract:
There is often a significant gap between research results and applicability in routine medical practice. This work studies the performance of well-known local features on a medical dataset captured during routine colonoscopy procedures. Local feature extraction and matching is a key step for many computer vision applications, specially regarding 3D modelling. In the medical domain, handcrafted loc…
▽ More
There is often a significant gap between research results and applicability in routine medical practice. This work studies the performance of well-known local features on a medical dataset captured during routine colonoscopy procedures. Local feature extraction and matching is a key step for many computer vision applications, specially regarding 3D modelling. In the medical domain, handcrafted local features such as SIFT, with public pipelines such as COLMAP, are still a predominant tool for this kind of tasks. We explore the potential of the well known self-supervised approach SuperPoint, present an adapted variation for the endoscopic domain and propose a challenging evaluation framework. SuperPoint based models achieve significantly higher matching quality than commonly used local features in this domain. Our adapted model avoids features within specularity regions, a frequent and problematic artifact in endoscopic images, with consequent benefits for matching and reconstruction results.
△ Less
Submitted 9 January, 2023; v1 submitted 8 March, 2022;
originally announced March 2022.
