-
Stereo X-ray tomography on deformed object tracking
Authors:
Zhenduo Shang,
Thomas Blumensath
Abstract:
X-ray computed tomography is a powerful tool for volumetric imaging, but requires the collection of a large number of low-noise projection images, which is often too time consuming, limiting its applicability. In our previous work \cite{shang2023stereo}, we proposed a stereo X-ray tomography system to map the 3D position of fiducial markers using only two projections of a static volume. In dynamic…
▽ More
X-ray computed tomography is a powerful tool for volumetric imaging, but requires the collection of a large number of low-noise projection images, which is often too time consuming, limiting its applicability. In our previous work \cite{shang2023stereo}, we proposed a stereo X-ray tomography system to map the 3D position of fiducial markers using only two projections of a static volume. In dynamic imaging settings, where objects undergo deformations during imaging, this static method can be extended by utilizing additional temporal information. We thus extend the method to track the deformation of fiducial markers in 3D space, where we use knowledge of the initial object shape as prior information, improving the prediction of the evolution of its deformed state over time. In particular, knowledge of the initial object's stereo projections is shown to improve the method's robustness to noise when detecting fiducial marker locations in the projections of the deformed objects. Furthermore, after feature detection, by using the features' initial 3D position information in the undeformed object, we can also demonstrate improvements in the 3D mapping of the deformed features. Using a range of deformed 3D objects, this new approach is shown to be able to track fiducial markers in noisy stereo tomography images with subpixel accuracy.
△ Less
Submitted 30 April, 2025;
originally announced May 2025.
-
Imaging on the Edge: Mapping Object Corners and Edges with Stereo X-ray Tomography
Authors:
Zhenduo Shang,
Thomas Blumensath
Abstract:
X-ray computed tomography is a powerful tool for volumetric imaging, where three-dimensional (3D) images are generated from a large number of individual X-ray projection images. Collecting the required number of low noise projection images is however time-consuming and so the technique is not currently applicable when spatial information needs to be collected with high temporal resolution, such as…
▽ More
X-ray computed tomography is a powerful tool for volumetric imaging, where three-dimensional (3D) images are generated from a large number of individual X-ray projection images. Collecting the required number of low noise projection images is however time-consuming and so the technique is not currently applicable when spatial information needs to be collected with high temporal resolution, such as in the study of dynamic processes. In our previous work, inspired by stereo vision, we developed stereo X-ray imaging methods that operate with only two X-ray projection images. Previously we have shown how this allowed us to map point and line fiducial markers into 3D space at significantly faster temporal resolutions. In this paper, we make two further contributions. Firstly, instead of utilising internal fiducial markers, we demonstrate the applicability of the method to the 3D mapping of sharp object corners, a problem of interest in measuring the deformation of manufactured components under different loads. Furthermore, we demonstrate how the approach can be applied to real stereo X-ray data, even in settings where we do not have the annotated real training data that was required for the training of our previous Machine Learning approach. This is achieved by substituting the real data with a relatively simple synthetic training dataset designed to mimic key aspects of the real data.
△ Less
Submitted 29 April, 2025;
originally announced April 2025.
-
TIGRE v3: Efficient and easy to use iterative computed tomographic reconstruction toolbox for real datasets
Authors:
Ander Biguri,
Tomoyuki Sadakane,
Reuben Lindroos,
Yi Liu,
Malena Sabaté Landman,
Yi Du,
Manasavee Lohvithee,
Stefanie Kaser,
Sepideh Hatamikia,
Robert Bryll,
Emilien Valat,
Sarinrat Wonglee,
Thomas Blumensath,
Carola-Bibiane Schönlieb
Abstract:
Computed Tomography (CT) has been widely adopted in medicine and it is increasingly being used in scientific and industrial applications. Parallelly, research in different mathematical areas concerning discrete inverse problems has led to the development of new sophisticated numerical solvers that can be applied in the context of CT. The Tomographic Iterative GPU-based Reconstruction (TIGRE) toolb…
▽ More
Computed Tomography (CT) has been widely adopted in medicine and it is increasingly being used in scientific and industrial applications. Parallelly, research in different mathematical areas concerning discrete inverse problems has led to the development of new sophisticated numerical solvers that can be applied in the context of CT. The Tomographic Iterative GPU-based Reconstruction (TIGRE) toolbox was born almost a decade ago precisely in the gap between mathematics and high performance computing for real CT data, providing user-friendly open-source software tools for image reconstruction. However, since its inception, the tools' features and codebase have had over a twenty-fold increase, and are now including greater geometric flexibility, a variety of modern algorithms for image reconstruction, high-performance computing features and support for other CT modalities, like proton CT. The purpose of this work is two-fold: first, it provides a structured overview of the current version of the TIGRE toolbox, providing appropriate descriptions and references, and serving as a comprehensive and peer-reviewed guide for the user; second, it is an opportunity to illustrate the performance of several of the available solvers showcasing real CT acquisitions, which are typically not be openly available to algorithm developers.
△ Less
Submitted 13 December, 2024;
originally announced December 2024.
-
Invertible Low-Dimensional Modelling of X-ray Absorption Spectra for Potential Applications in Spectral X-ray Imaging
Authors:
Raziye Kubra Kumrular,
Thomas Blumensath
Abstract:
X-ray interaction with matter is an energy-dependent process that is contingent on the atomic structure of the constituent material elements. The most advanced models to capture this relationship currently rely on Monte Carlo (MC) simulations. Whilst these very accurate models, in many problems in spectral X-ray imaging, such as data compression, noise removal, spectral estimation, and the quantit…
▽ More
X-ray interaction with matter is an energy-dependent process that is contingent on the atomic structure of the constituent material elements. The most advanced models to capture this relationship currently rely on Monte Carlo (MC) simulations. Whilst these very accurate models, in many problems in spectral X-ray imaging, such as data compression, noise removal, spectral estimation, and the quantitative measurement of material compositions, these models are of limited use, as these applications typically require the efficient inversion of the model, that is, they require the estimation of the best model parameters for a given spectral measurement. Current models that can be easily inverted however typically only work when modelling spectra in regions away from their K-edges, so they have limited utility when modelling a wider range of materials. In this paper, we thus propose a novel, non-linear model that combines a deep neural network autoencoder with an optimal linear model based on the Singular Value Decomposition (SVD). We compare our new method to other alternative linear and non-linear approaches, a sparse model and an alternative deep learning model. We demonstrate the advantages of our method over traditional models, especially when modelling X-ray absorption spectra that contain K-edges in the energy range of interest.
△ Less
Submitted 10 July, 2023;
originally announced July 2023.
-
The realisation of fast X-ray computed tomography using a limited number of projection images for dimensional metrology
Authors:
Wenjuan Sun,
Stephan Chretien,
Ander Biguri,
Manuchehr Soleimani,
Thomas Blumensath,
Jessica Talbott
Abstract:
Due to the merit of establishing volumetric data, X-ray computed tomography (XCT) is increasingly used as a non-destructive evaluation technique in the quality control of advanced manufactured parts with complex non-line-of-sight features. However, the cost of measurement time and data storage hampers the adoption of the technique in production lines. Commercial fast XCT utilises X-ray detectors w…
▽ More
Due to the merit of establishing volumetric data, X-ray computed tomography (XCT) is increasingly used as a non-destructive evaluation technique in the quality control of advanced manufactured parts with complex non-line-of-sight features. However, the cost of measurement time and data storage hampers the adoption of the technique in production lines. Commercial fast XCT utilises X-ray detectors with fast detection capability, which can be expensive and results a large amount of data. This paper discussed a different approach, where fast XCT was realised via the acquisition of a small number of projection images instead of full projection images. An established total variation (TV) algorithm was used to handle the reconstruction. The paper investigates the feasibility of using the TV algorithm in handling a significantly reduced number of projection images for reconstruction. This allows a reduction of measurement time from fifty-two minutes to one minute for a typical industrial XCT system. It also enables a reduction of data size proportionally. A test strategy including both quantitative and qualitative test metrics was considered to evaluate the effectiveness of the reconstruction algorithm. The qualitative evaluation includes both the signal to noise ratio and the contrast to noise ratio. The quantitative evaluation was established using reference samples with different internal and external geometries. Simulation data were used in the assessment considering various influence factors, such as X-ray source property and instrument noise. The results demonstrated the possibility of using advanced reconstruction algorithms in handling XCT measurements with a significantly limited number of projection images for dimensional measurements.
△ Less
Submitted 17 May, 2023;
originally announced May 2023.
-
Stereo X-ray Tomography
Authors:
Zhenduo Shang,
Thomas Blumensath
Abstract:
X-ray tomography is a powerful volumetric imaging technique, but detailed three dimensional (3D) imaging requires the acquisition of a large number of individual X-ray images, which is time consuming. For applications where spatial information needs to be collected quickly, for example, when studying dynamic processes, standard X-ray tomography is therefore not applicable. Inspired by stereo visio…
▽ More
X-ray tomography is a powerful volumetric imaging technique, but detailed three dimensional (3D) imaging requires the acquisition of a large number of individual X-ray images, which is time consuming. For applications where spatial information needs to be collected quickly, for example, when studying dynamic processes, standard X-ray tomography is therefore not applicable. Inspired by stereo vision, in this paper, we develop X-ray imaging methods that work with two X-ray projection images. In this setting, without the use of additional strong prior information, we no longer have enough information to fully recover the 3D tomographic images. However, up to a point, we are nevertheless able to extract spatial locations of point and line features. From stereo vision, it is well known that, for a known imaging geometry, once the same point is identified in two images taken from different directions, then the point's location in 3D space is exactly specified. The challenge is the matching of points between images. As X-ray transmission images are fundamentally different from the surface reflection images used in standard computer vision, we here develop a different feature identification and matching approach. In fact, once point like features are identified, if there are limited points in the image, then they can often be matched exactly. In fact, by utilising a third observation from an appropriate direction, matching becomes unique. Once matched, point locations in 3D space are easily computed using geometric considerations. Linear features, with clear end points, can be located using a similar approach.
△ Less
Submitted 25 February, 2023;
originally announced February 2023.
-
Data-Driven Interpolation for Super-Scarce X-Ray Computed Tomography
Authors:
Emilien Valat,
Katayoun Farrahi,
Thomas Blumensath
Abstract:
We address the problem of reconstructing X-Ray tomographic images from scarce measurements by interpolating missing acquisitions using a self-supervised approach. To do so, we train shallow neural networks to combine two neighbouring acquisitions into an estimated measurement at an intermediate angle. This procedure yields an enhanced sequence of measurements that can be reconstructed using standa…
▽ More
We address the problem of reconstructing X-Ray tomographic images from scarce measurements by interpolating missing acquisitions using a self-supervised approach. To do so, we train shallow neural networks to combine two neighbouring acquisitions into an estimated measurement at an intermediate angle. This procedure yields an enhanced sequence of measurements that can be reconstructed using standard methods, or further enhanced using regularisation approaches.
Unlike methods that improve the sequence of acquisitions using an initial deterministic interpolation followed by machine-learning enhancement, we focus on inferring one measurement at once. This allows the method to scale to 3D, the computation to be faster and crucially, the interpolation to be significantly better than the current methods, when they exist. We also establish that a sequence of measurements must be processed as such, rather than as an image or a volume. We do so by comparing interpolation and up-sampling methods, and find that the latter significantly under-perform.
We compare the performance of the proposed method against deterministic interpolation and up-sampling procedures and find that it outperforms them, even when used jointly with a state-of-the-art projection-data enhancement approach using machine-learning. These results are obtained for 2D and 3D imaging, on large biomedical datasets, in both projection space and image space.
△ Less
Submitted 16 May, 2022;
originally announced May 2022.
-
Sinogram Enhancement with Generative Adversarial Networks using Shape Priors
Authors:
Emilien Valat,
Katayoun Farrahi,
Thomas Blumensath
Abstract:
Compensating scarce measurements by inferring them from computational models is a way to address ill-posed inverse problems. We tackle Limited Angle Tomography by completing the set of acquisitions using a generative model and prior-knowledge about the scanned object. Using a Generative Adversarial Network as model and Computer-Assisted Design data as shape prior, we demonstrate a quantitative and…
▽ More
Compensating scarce measurements by inferring them from computational models is a way to address ill-posed inverse problems. We tackle Limited Angle Tomography by completing the set of acquisitions using a generative model and prior-knowledge about the scanned object. Using a Generative Adversarial Network as model and Computer-Assisted Design data as shape prior, we demonstrate a quantitative and qualitative advantage of our technique over other state-of-the-art methods. Inferring a substantial number of consecutive missing measurements, we offer an alternative to other image inpainting techniques that fall short of providing a satisfying answer to our research question: can X-Ray exposition be reduced by using generative models to infer lacking measurements?
△ Less
Submitted 1 February, 2022;
originally announced February 2022.
-
Numerically robust tetrahedron-based tomographic forward and backward projectors on parallel architectures
Authors:
Ander Biguri,
Hossein Towsyfyan,
Richard Boardman,
Thomas Blumensath
Abstract:
X-ray tomographic reconstruction typically uses voxel basis functions to represent volumetric images. Due to the structure in voxel basis representations, efficient ray-tracing methods exist allowing fast, GPU accelerated implementations. Tetrahedral mesh basis functions are a valuable alternative to voxel based image representations as they provide flexible, inhomogeneous partitionings which can…
▽ More
X-ray tomographic reconstruction typically uses voxel basis functions to represent volumetric images. Due to the structure in voxel basis representations, efficient ray-tracing methods exist allowing fast, GPU accelerated implementations. Tetrahedral mesh basis functions are a valuable alternative to voxel based image representations as they provide flexible, inhomogeneous partitionings which can be used to provide reconstructions with reduced numbers of elements or with arbitrarily fine object surface representations. We thus present a robust parallelizable ray-tracing method for volumetric tetrahedral domains developed specifically for Computed Tomography image reconstruction. Tomographic image reconstruction requires algorithms that are robust to numerical errors in floating point arithmetic whilst typical data sizes encountered in tomography require the algorithm to be parallelisable in GPUs which leads to additional constraints on algorithm choices. Based on these considerations, this article presents numerical solutions to the design of efficient ray-tracing algorithms for the projection and backprojection operations. Initial reconstruction results using CAD data to define a triangulation of the domain demonstrate the advantages of our method and contrast tetrahedral mesh based reconstructions to voxel based methods.
△ Less
Submitted 19 August, 2019;
originally announced August 2019.
-
Arbitrarily large iterative tomographic reconstruction on multiple GPUs using the TIGRE toolbox
Authors:
Ander Biguri,
Reuben Lindroos,
Robert Bryll,
Hossein Towsyfyan,
Hans Deyhle,
Richard Boardman,
Mark Mavrogordato,
Manjit Dosanjh,
Steven Hancock,
Thomas Blumensath
Abstract:
Tomographic image sizes keep increasing over time and while the GPUs that compute the tomographic reconstruction are also increasing in memory size, they are not doing so fast enough to reconstruct the largest datasets. This problem is often solved by reconstructing data in large clusters of GPUs with enough devices to fit the measured X-ray projections and reconstructed volume. Often this require…
▽ More
Tomographic image sizes keep increasing over time and while the GPUs that compute the tomographic reconstruction are also increasing in memory size, they are not doing so fast enough to reconstruct the largest datasets. This problem is often solved by reconstructing data in large clusters of GPUs with enough devices to fit the measured X-ray projections and reconstructed volume. Often this requires tens of GPUs, which is a very economically expensive solution. Access to single-node machines designed to reconstruct using just one or a few GPUs is more common in the field, but current software does not allow iterative reconstruction of volumes that do not fit in those GPUs. In this work, we propose a strategy to execute efficiently the required operations for iterative reconstruction for arbitrarily large images with any number of GPUs with arbitrarily small memories in a single node. Strategies for both the forward and backprojection operators are presented, along with two regularization approaches that are easily generalized to other projection types or regularizers. The proposed improvement also accelerates reconstruction of smaller images on single or multiple GPUs, providing faster code for time-critical medical applications. The resulting algorithm has been added to the TIGRE toolbox, a repository for iterative reconstruction algorithms for general CT, but this memory-saving and problem-splitting strategy can be easily adapted for any other GPU-based CT code.
△ Less
Submitted 8 May, 2019;
originally announced May 2019.
-
Block stochastic gradient descent for large-scale tomographic reconstruction in a parallel network
Authors:
Yushan Gao,
Ander Biguri,
Thomas Blumensath
Abstract:
Iterative algorithms have many advantages for linear tomographic image reconstruction when compared to back-projection based methods. However, iterative methods tend to have significantly higher computational complexity. To overcome this, parallel processing schemes that can utilise several computing nodes are desirable. Popular methods here are row action methods, which update the entire image si…
▽ More
Iterative algorithms have many advantages for linear tomographic image reconstruction when compared to back-projection based methods. However, iterative methods tend to have significantly higher computational complexity. To overcome this, parallel processing schemes that can utilise several computing nodes are desirable. Popular methods here are row action methods, which update the entire image simultaneously and column action methods, which require access to all measurements at each node. In large scale tomographic reconstruction with limited storage capacity of each node, data communication overheads between nodes becomes a significant performance limiting factor. To reduce this overhead, we proposed a row action method BSGD. The method is based on the stochastic gradient descent method but it does not update the entire image at each iteration, which reduces between node communication. To further increase convergence speeds, an importance sampling strategy is proposed. We compare BSGD to other existing stochastic methods and show its effectiveness and efficiency. Other properties of BSGD are also explored, including its ability to incorporate total variation (TV) regularization and automatic parameter tuning.
△ Less
Submitted 28 March, 2019;
originally announced March 2019.
-
BSGD-TV: A parallel algorithm solving total variation constrained image reconstruction problems
Authors:
Yushan Gao,
Thomas Blumensath
Abstract:
We propose a parallel reconstruction algorithm to solve large scale TV constrained linear inverse problems. We provide a convergence proof and show numerically that our method is significantly faster than the main competitor, block ADMM.
We propose a parallel reconstruction algorithm to solve large scale TV constrained linear inverse problems. We provide a convergence proof and show numerically that our method is significantly faster than the main competitor, block ADMM.
△ Less
Submitted 4 December, 2018;
originally announced December 2018.
-
Distributed Computation of Linear Inverse Problems with Application to Computed Tomography
Authors:
Yushan Gao,
Thomas Blumensath
Abstract:
The inversion of linear systems is a fundamental step in many inverse problems. Computational challenges exist when trying to invert large linear systems, where limited computing resources mean that only part of the system can be kept in computer memory at any one time. We are here motivated by tomographic inversion problems that often lead to linear inverse problems. In state of the art x-ray sys…
▽ More
The inversion of linear systems is a fundamental step in many inverse problems. Computational challenges exist when trying to invert large linear systems, where limited computing resources mean that only part of the system can be kept in computer memory at any one time. We are here motivated by tomographic inversion problems that often lead to linear inverse problems. In state of the art x-ray systems, even a standard scan can produce 4 million individual measurements and the reconstruction of x-ray attenuation profiles typically requires the estimation of a million attenuation coefficients. To deal with the large data sets encountered in real applications and to utilise modern graphics processing unit (GPU) based computing architectures, combinations of iterative reconstruction algorithms and parallel computing schemes are increasingly applied. Although both row and column action methods have been proposed to utilise parallel computing architectures, individual computations in current methods need to know either the entire set of observations or the entire set of estimated x-ray absorptions, which can be prohibitive in many realistic big data applications. We present a fully parallelizable computed tomography (CT) image reconstruction algorithm that works with arbitrary partial subsets of the data and the reconstructed volume. We further develop a non-homogeneously randomised selection criteria which guarantees that sub-matrices of the system matrix are selected more frequently if they are dense, thus maximising information flow through the algorithm. A grouped version of the algorithm is also proposed to further improve convergence speed and performance. Algorithm performance is verified experimentally.
△ Less
Submitted 4 September, 2017;
originally announced September 2017.
-
Compressed Sensing with Nonlinear Observations and Related Nonlinear Optimisation Problems
Authors:
Thomas Blumensath
Abstract:
Non-convex constraints have recently proven a valuable tool in many optimisation problems. In particular sparsity constraints have had a significant impact on sampling theory, where they are used in Compressed Sensing and allow structured signals to be sampled far below the rate traditionally prescribed.
Nearly all of the theory developed for Compressed Sensing signal recovery assumes that sampl…
▽ More
Non-convex constraints have recently proven a valuable tool in many optimisation problems. In particular sparsity constraints have had a significant impact on sampling theory, where they are used in Compressed Sensing and allow structured signals to be sampled far below the rate traditionally prescribed.
Nearly all of the theory developed for Compressed Sensing signal recovery assumes that samples are taken using linear measurements. In this paper we instead address the Compressed Sensing recovery problem in a setting where the observations are non-linear. We show that, under conditions similar to those required in the linear setting, the Iterative Hard Thresholding algorithm can be used to accurately recover sparse or structured signals from few non-linear observations.
Similar ideas can also be developed in a more general non-linear optimisation framework. In the second part of this paper we therefore present related result that show how this can be done under sparsity and union of subspaces constraints, whenever a generalisation of the Restricted Isometry Property traditionally imposed on the Compressed Sensing system holds.
△ Less
Submitted 8 May, 2012;
originally announced May 2012.
-
Non-convexly constrained linear inverse problems
Authors:
Thomas Blumensath
Abstract:
This paper considers the inversion of ill-posed linear operators. To regularise the problem the solution is enforced to lie in a non-convex subset. Theoretical properties for the stable inversion are derived and an iterative algorithm akin to the projected Landweber algorithm is studied. This work extends recent progress made on the efficient inversion of finite dimensional linear systems under…
▽ More
This paper considers the inversion of ill-posed linear operators. To regularise the problem the solution is enforced to lie in a non-convex subset. Theoretical properties for the stable inversion are derived and an iterative algorithm akin to the projected Landweber algorithm is studied. This work extends recent progress made on the efficient inversion of finite dimensional linear systems under a sparsity constraint to the Hilbert space setting and to more general non-convex constraints.
△ Less
Submitted 26 November, 2009;
originally announced November 2009.
-
Sampling and reconstructing signals from a union of linear subspaces
Authors:
Thomas Blumensath
Abstract:
In this note we study the problem of sampling and reconstructing signals which are assumed to lie on or close to one of several subspaces of a Hilbert space. Importantly, we here consider a very general setting in which we allow infinitely many subspaces in infinite dimensional Hilbert spaces. This general approach allows us to unify many results derived recently in areas such as compressed sens…
▽ More
In this note we study the problem of sampling and reconstructing signals which are assumed to lie on or close to one of several subspaces of a Hilbert space. Importantly, we here consider a very general setting in which we allow infinitely many subspaces in infinite dimensional Hilbert spaces. This general approach allows us to unify many results derived recently in areas such as compressed sensing, affine rank minimisation and analog compressed sensing.
Our main contribution is to show that a conceptually simple iterative projection algorithms is able to recover signals from a union of subspaces whenever the sampling operator satisfies a bi-Lipschitz embedding condition. Importantly, this result holds for all Hilbert spaces and unions of subspaces, as long as the sampling procedure satisfies the condition for the set of subspaces considered. In addition to recent results for finite unions of finite dimensional subspaces and infinite unions of subspaces in finite dimensional spaces, we also show that this bi-Lipschitz property can hold in an analog compressed sensing setting in which we have an infinite union of infinite dimensional subspaces living in infinite dimensional space.
△ Less
Submitted 2 December, 2009; v1 submitted 18 November, 2009;
originally announced November 2009.
-
Iterative Hard Thresholding for Compressed Sensing
Authors:
Thomas Blumensath,
Mike E. Davies
Abstract:
Compressed sensing is a technique to sample compressible signals below the Nyquist rate, whilst still allowing near optimal reconstruction of the signal. In this paper we present a theoretical analysis of the iterative hard thresholding algorithm when applied to the compressed sensing recovery problem. We show that the algorithm has the following properties (made more precise in the main text of…
▽ More
Compressed sensing is a technique to sample compressible signals below the Nyquist rate, whilst still allowing near optimal reconstruction of the signal. In this paper we present a theoretical analysis of the iterative hard thresholding algorithm when applied to the compressed sensing recovery problem. We show that the algorithm has the following properties (made more precise in the main text of the paper)
- It gives near-optimal error guarantees.
- It is robust to observation noise.
- It succeeds with a minimum number of observations.
- It can be used with any sampling operator for which the operator and its adjoint can be computed.
- The memory requirement is linear in the problem size.
- Its computational complexity per iteration is of the same order as the application of the measurement operator or its adjoint.
- It requires a fixed number of iterations depending only on the logarithm of a form of signal to noise ratio of the signal.
- Its performance guarantees are uniform in that they only depend on properties of the sampling operator and signal sparsity.
△ Less
Submitted 5 May, 2008;
originally announced May 2008.