Adaptive Plane Reformatting for 4D Flow MRI using Deep Reinforcement Learning
Authors:
Javier Bisbal,
Julio Sotelo,
Maria I Valdés,
Pablo Irarrazaval,
Marcelo E Andia,
Julio García,
José Rodriguez-Palomarez,
Francesca Raimondi,
Cristián Tejos,
Sergio Uribe
Abstract:
Deep reinforcement learning (DRL) algorithms have shown robust results in plane reformatting tasks. In these methods, an agent sequentially adjusts the position and orientation of an initial plane towards an objective location. This process allows accurate plane reformatting, without the need for detailed landmarks, which makes it suitable for images with limited contrast and resolution, such as 4…
▽ More
Deep reinforcement learning (DRL) algorithms have shown robust results in plane reformatting tasks. In these methods, an agent sequentially adjusts the position and orientation of an initial plane towards an objective location. This process allows accurate plane reformatting, without the need for detailed landmarks, which makes it suitable for images with limited contrast and resolution, such as 4D flow MRI. However, current DRL methods require the test dataset to be in the same position and orientation as the training dataset. In this paper, we present a novel technique that utilizes a flexible coordinate system based on the current state, enabling navigation in volumes at any position or orientation. We adopted the Asynchronous Advantage Actor Critic (A3C) algorithm for reinforcement learning, outperforming Deep Q Network (DQN). Experimental results in 4D flow MRI demonstrate improved accuracy in plane reformatting angular and distance errors (6.32 +- 4.15 ° and 3.40 +- 2.75 mm), as well as statistically equivalent flow measurements determined by a plane reformatting process done by an expert (p=0.21). The method's flexibility and adaptability make it a promising candidate for other medical imaging applications beyond 4D flow MRI.
△ Less
Submitted 31 May, 2025;
originally announced June 2025.
A Survey on Deep Learning and Explainability for Automatic Report Generation from Medical Images
Authors:
Pablo Messina,
Pablo Pino,
Denis Parra,
Alvaro Soto,
Cecilia Besa,
Sergio Uribe,
Marcelo andía,
Cristian Tejos,
Claudia Prieto,
Daniel Capurro
Abstract:
Every year physicians face an increasing demand of image-based diagnosis from patients, a problem that can be addressed with recent artificial intelligence methods. In this context, we survey works in the area of automatic report generation from medical images, with emphasis on methods using deep neural networks, with respect to: (1) Datasets, (2) Architecture Design, (3) Explainability and (4) Ev…
▽ More
Every year physicians face an increasing demand of image-based diagnosis from patients, a problem that can be addressed with recent artificial intelligence methods. In this context, we survey works in the area of automatic report generation from medical images, with emphasis on methods using deep neural networks, with respect to: (1) Datasets, (2) Architecture Design, (3) Explainability and (4) Evaluation Metrics. Our survey identifies interesting developments, but also remaining challenges. Among them, the current evaluation of generated reports is especially weak, since it mostly relies on traditional Natural Language Processing (NLP) metrics, which do not accurately capture medical correctness.
△ Less
Submitted 8 January, 2022; v1 submitted 20 October, 2020;
originally announced October 2020.
