-
Shape-based pose estimation for automatic standard views of the knee
Authors:
Lisa Kausch,
Sarina Thomas,
Holger Kunze,
Jan Siad El Barbari,
Klaus Maier-Hein
Abstract:
Surgical treatment of complicated knee fractures is guided by real-time imaging using a mobile C-arm. Immediate and continuous control is achieved via 2D anatomy-specific standard views that correspond to a specific C-arm pose relative to the patient positioning, which is currently determined manually, following a trial-and-error approach at the cost of time and radiation dose. The characteristics…
▽ More
Surgical treatment of complicated knee fractures is guided by real-time imaging using a mobile C-arm. Immediate and continuous control is achieved via 2D anatomy-specific standard views that correspond to a specific C-arm pose relative to the patient positioning, which is currently determined manually, following a trial-and-error approach at the cost of time and radiation dose. The characteristics of the standard views of the knee suggests that the shape information of individual bones could guide an automatic positioning procedure, reducing time and the amount of unnecessary radiation during C-arm positioning. To fully automate the C-arm positioning task during knee surgeries, we propose a complete framework that enables (1) automatic laterality and standard view classification and (2) automatic shape-based pose regression toward the desired standard view based on a single initial X-ray. A suitable shape representation is proposed to incorporate semantic information into the pose regression pipeline. The pipeline is designed to handle two distinct standard views simultaneously. Experiments were conducted to assess the performance of the proposed system on 3528 synthetic and 1386 real X-rays for the a.-p. and lateral standard. The view/laterality classificator resulted in an accuracy of 100\%/98\% on the simulated and 99\%/98\% on the real X-rays. The pose regression performance was $dθ_{a.-p}=5.8\pm3.3\degree,\,dθ_{lateral}=3.7\pm2.0\degree$ on the simulated data and $dθ_{a.-p}=7.4\pm5.0\degree,\,dθ_{lateral}=8.4\pm5.4\degree$ on the real data outperforming intensity-based pose regression.
△ Less
Submitted 26 May, 2023;
originally announced May 2023.
-
Automatic Plane Adjustment of Orthopedic Intra-operative Flat Panel Detector CT-Volumes
Authors:
Celia Martin Vicario,
Florian Kordon,
Felix Denzinger,
Jan Siad El Barbari,
Maxim Privalov,
Jochen Franke,
Sarina Thomas,
Lisa Kausch,
Andreas Maier,
Holger Kunze
Abstract:
Purpose
3D acquisitions are often acquired to assess the result in orthopedic trauma surgery. With a mobile C-Arm system, these acquisitions can be performed intra-operatively. That reduces the number of required revision surgeries. However, due to the operation room setup, the acquisitions typically cannot be performed such that the acquired volumes are aligned to the anatomical regions. Thus,…
▽ More
Purpose
3D acquisitions are often acquired to assess the result in orthopedic trauma surgery. With a mobile C-Arm system, these acquisitions can be performed intra-operatively. That reduces the number of required revision surgeries. However, due to the operation room setup, the acquisitions typically cannot be performed such that the acquired volumes are aligned to the anatomical regions. Thus, the multiplanar reconstructed (MPR) planes need to be adjusted manually during the review of the volume. In this paper, we present a detailed study of multi-task learning (MTL) regression networks to estimate the parameters of the MPR planes.
Approach
First, various mathematical descriptions for rotation, including Euler angle, quaternion, and matrix representation, are revised. Then, three different MTL network architectures based on the PoseNet are compared with a single task learning network.
Results
Using a matrix description rather than the Euler angle description, the accuracy of the regressed normals improves from $7.7^{\circ}$ to $7.3^{\circ}$ in the mean value for single anatomies. The multi-head approach improves the regression of the plane position from $7.4mm$ to $6.1mm$, while the orientation does not benefit from this approach.
Conclusions
The results show that a multi-head approach can lead to slightly better results than the individual tasks networks. The most important benefit of the MTL approach is that it is a single network for standard plane regression for all body regions with a reduced number of stored parameters.
△ Less
Submitted 15 September, 2021;
originally announced September 2021.
-
C-Arm Non-Circular Orbits: Geometric Calibration, Image Quality, and Avoidance of Metal Artifacts
Authors:
Pengwei Wu,
Niral Sheth,
Alejandro Sisniega,
Tongyu Wang,
Ali Uneri,
Runze Han,
Rohan Vijayan,
Prasad Vagdargi,
Bjoern Kreher,
Holger Kunze,
Gerhard Kleinszig,
Sebastian Vogt,
Sheng-Fu Larry Lo,
Nicholas Theodore,
Jeffrey Siewerdsen
Abstract:
Metal artifacts present a frequent challenge to cone-beam CT (CBCT) in image-guided surgery, obscuring visualization of metal instruments and adjacent anatomy. Recent advances in mobile C-arm systems have enabled 3D imaging capacity with non-circular orbits. We extend a previously proposed metal artifacts avoidance (MAA) method to reduce the influence of metal artifacts by prospectively defining a…
▽ More
Metal artifacts present a frequent challenge to cone-beam CT (CBCT) in image-guided surgery, obscuring visualization of metal instruments and adjacent anatomy. Recent advances in mobile C-arm systems have enabled 3D imaging capacity with non-circular orbits. We extend a previously proposed metal artifacts avoidance (MAA) method to reduce the influence of metal artifacts by prospectively defining a non-circular orbit that avoids metal-induced biases in projection domain. Accurate geometric calibration is an important challenge to accurate 3D image reconstruction for such orbits. We investigate the performance of interpolation-based calibration from a library of circular orbits for any non-circular orbit. We apply the method to non-circular scans acquired for MAA, which involves: (i) coarse 3D localization of metal objects via only two scout views using an end-to-end trained neural network; (ii) calculation of the metal-induced x-ray spectral shift for all possible views; and (iii) identification of the non-circular orbit that minimizes the variations in spectral shift. Non-circular orbits with interpolation-based geometric calibration yielded reasonably accurate 3D image reconstruction. The end-to-end neural network accurately localized metal implants with just two scout views even in complex anatomical scenes, improving Dice coefficient by ~42% compared to a more conventional cascade of separately trained U-nets. In a spine phantom with pedicle screw instrumentation, non-circular orbits identified by the MAA method reduced the magnitude of metal "blomming" artifacts (apparent width of the screw shaft) in CBCT reconstructions by ~70%. The proposed imaging and calibration methods present a practical means to improve image quality in mobile C-arm CBCT by identifying non-circular scan protocols that improve sampling and reduce metal-induced biases in the projection data.
△ Less
Submitted 30 September, 2020;
originally announced October 2020.
-
Automatic Plane Adjustment of Orthopedic Intraoperative Flat Panel Detector CT-Volumes
Authors:
Celia Martín Vicario,
Florian Kordon,
Felix Denzinger,
Markus Weiten,
Sarina Thomas,
Lisa Kausch,
Jochen Franke,
Holger Keil,
Andreas Maier,
Holger Kunze
Abstract:
Flat panel computed tomography is used intraoperatively to assess the result of surgery. Due to workflow issues, the acquisition typically cannot be carried out in such a way that the axis aligned multiplanar reconstructions (MPR) of the volume match the anatomically aligned MPRs. This needs to be performed manually, adding additional effort during viewing the datasets. A PoseNet convolutional neu…
▽ More
Flat panel computed tomography is used intraoperatively to assess the result of surgery. Due to workflow issues, the acquisition typically cannot be carried out in such a way that the axis aligned multiplanar reconstructions (MPR) of the volume match the anatomically aligned MPRs. This needs to be performed manually, adding additional effort during viewing the datasets. A PoseNet convolutional neural network (CNN) is trained such that parameters of anatomically aligned MPR planes are regressed. Different mathematical approaches to describe plane rotation are compared, as well as a cost function is optimized to incorporate orientation constraints. The CNN is evaluated on two anatomical regions. For one of these regions, one plane is not orthogonal to the other two planes. The plane's normal can be estimated with a median accuracy of 5°, the in-plane rotation with an accuracy of 6°, and the position with an accuracy of 6 mm. Compared to state-of-the-art algorithms the labeling effort for this method is much lower as no segmentation is required. The computation time during inference is less than 0.05 s.
△ Less
Submitted 7 July, 2020;
originally announced July 2020.
-
Contour-based Bone Axis Detection for X-Ray Guided Surgery on the Knee
Authors:
Florian Kordon,
Andreas Maier,
Benedict Swartman,
Maxim Privalov,
Jan Siad El Barbari,
Holger Kunze
Abstract:
The anatomical axis of long bones is an important reference line for guiding fracture reduction and assisting in the correct placement of guide pins, screws, and implants in orthopedics and trauma surgery. This study investigates an automatic approach for detection of such axes on X-ray images based on the segmentation contour of the bone. For this purpose, we use the medically established two-lin…
▽ More
The anatomical axis of long bones is an important reference line for guiding fracture reduction and assisting in the correct placement of guide pins, screws, and implants in orthopedics and trauma surgery. This study investigates an automatic approach for detection of such axes on X-ray images based on the segmentation contour of the bone. For this purpose, we use the medically established two-line method and translate it into a learning-based approach. The proposed method is evaluated on 38 clinical test images of the femoral and tibial bone and achieves a median angulation error of 0.19° and 0.33° respectively. An inter-rater study with three trauma surgery experts confirms reliability of the method and recommends further clinical application.
△ Less
Submitted 5 July, 2020;
originally announced July 2020.
-
A Multicriteria Macroeconomic Model with Intertemporal Equity and Spatial Spillovers
Authors:
Herb Kunze,
Davide La Torre,
Simone Marsiglio
Abstract:
We analyze a macroeconomic model with intergenerational equity considerations and spatial spillovers, which gives rise to a multicriteria optimization problem. Intergenerational equity requires to add in the definition of social welfare a long run sustainability criterion to the traditional discounted utilitarian criterion. The spatial structure allows for the possibility of heterogeneiity and spa…
▽ More
We analyze a macroeconomic model with intergenerational equity considerations and spatial spillovers, which gives rise to a multicriteria optimization problem. Intergenerational equity requires to add in the definition of social welfare a long run sustainability criterion to the traditional discounted utilitarian criterion. The spatial structure allows for the possibility of heterogeneiity and spatial diffusion implies that all locations within the spatial domain are interconnected via spatial spillovers. We rely on different techniques (scalarization, $ε$-constraint method and goal programming) to analyze such a spatial multicriteria problem, relying on numerical approaches to illustrate the nature of the trade-off between the discounted utilitarian and the sustainability criteria.
△ Less
Submitted 19 November, 2019;
originally announced November 2019.
-
Solving Inverse Problems for Steady-State Equations using A Multiple Criteria Model with Collage Distance, Entropy, and Sparsity
Authors:
Herb Kunze,
Davide La Torre
Abstract:
In this paper, we extend the previous method for solving inverse problems for steady-state equations using the Generalized Collage Theorem by searching for an approximation that not only minimizes the collage error but also maximizes the entropy and minimize the sparsity. In this extended formulation, the parameter estimation minimization problem can be understood as a multiple criteria problem, w…
▽ More
In this paper, we extend the previous method for solving inverse problems for steady-state equations using the Generalized Collage Theorem by searching for an approximation that not only minimizes the collage error but also maximizes the entropy and minimize the sparsity. In this extended formulation, the parameter estimation minimization problem can be understood as a multiple criteria problem, with three different and conflicting criteria: The generalized collage error, the entropy associated with the unknown parameters, and the sparsity of the set of unknown parameters. We implement a scalarization technique to reduce the multiple criteria program to a single criterion one, by combining all objective functions with different trade-off weights. Numerical examples confirm that the collage method produces good, but sub-optimal, results. A relatively low-weighted entropy term allows for better approximations while the sparsity term decreases the complexity of the solution in terms of the number of elements in the basis.
△ Less
Submitted 7 November, 2019;
originally announced November 2019.
-
Using the Generalized Collage Theorem for Estimating Unknown Parameters in Perturbed Mixed Variational Equations
Authors:
A. I. Garralda-Guillem,
H. Kunze,
D. La Torre,
M. Ruiz Galan
Abstract:
In this paper, we study a mixed variational problem subject to perturbations, where the noise term is modelled by means of a bilinear form that has to be understood to be "small" in some sense. Indeed, we consider a family of such problems and provide a result that guarantees existence and uniqueness of the solution. Moreover, a stability condition for the solutions yields a Generalized Collage Th…
▽ More
In this paper, we study a mixed variational problem subject to perturbations, where the noise term is modelled by means of a bilinear form that has to be understood to be "small" in some sense. Indeed, we consider a family of such problems and provide a result that guarantees existence and uniqueness of the solution. Moreover, a stability condition for the solutions yields a Generalized Collage Theorem, which extends previous results by the same authors. We introduce the corresponding Galerkin method and study its convergence. We also analyze the associated inverse problem and we show how to solve it by means of the mentioned Generalized Collage Theorem and the use of adequate Schauder bases. Numerical examples show how the method works in a practical context.
△ Less
Submitted 6 November, 2019; v1 submitted 29 September, 2019;
originally announced September 2019.
-
Multi-task Localization and Segmentation for X-ray Guided Planning in Knee Surgery
Authors:
Florian Kordon,
Peter Fischer,
Maxim Privalov,
Benedict Swartman,
Marc Schnetzke,
Jochen Franke,
Ruxandra Lasowski,
Andreas Maier,
Holger Kunze
Abstract:
X-ray based measurement and guidance are commonly used tools in orthopaedic surgery to facilitate a minimally invasive workflow. Typically, a surgical planning is first performed using knowledge of bone morphology and anatomical landmarks. Information about bone location then serves as a prior for registration during overlay of the planning on intra-operative X-ray images. Performing these steps m…
▽ More
X-ray based measurement and guidance are commonly used tools in orthopaedic surgery to facilitate a minimally invasive workflow. Typically, a surgical planning is first performed using knowledge of bone morphology and anatomical landmarks. Information about bone location then serves as a prior for registration during overlay of the planning on intra-operative X-ray images. Performing these steps manually however is prone to intra-rater/inter-rater variability and increases task complexity for the surgeon. To remedy these issues, we propose an automatic framework for planning and subsequent overlay. We evaluate it on the example of femoral drill site planning for medial patellofemoral ligament reconstruction surgery. A deep multi-task stacked hourglass network is trained on 149 conventional lateral X-ray images to jointly localize two femoral landmarks, to predict a region of interest for the posterior femoral cortex tangent line, and to perform semantic segmentation of the femur, patella, tibia, and fibula with adaptive task complexity weighting. On 38 clinical test images the framework achieves a median localization error of 1.50 mm for the femoral drill site and mean IOU scores of 0.99, 0.97, 0.98, and 0.96 for the femur, patella, tibia, and fibula respectively. The demonstrated approach consistently performs surgical planning at expert-level precision without the need for manual correction.
△ Less
Submitted 24 July, 2019;
originally announced July 2019.