-
Can Deep Learning Assist Automatic Identification of Layered Pigments From XRF Data?
Authors:
Bingjie,
Xu,
Yunan Wu,
Pengxiao Hao,
Marc Vermeulen,
Alicia McGeachy,
Kate Smith,
Katherine Eremin,
Georgina Rayner,
Giovanni Verri,
Florian Willomitzer,
Matthias Alfeld,
Jack Tumblin,
Aggelos Katsaggelos,
Marc Walton
Abstract:
X-ray fluorescence spectroscopy (XRF) plays an important role for elemental analysis in a wide range of scientific fields, especially in cultural heritage. XRF imaging, which uses a raster scan to acquire spectra across artworks, provides the opportunity for spatial analysis of pigment distributions based on their elemental composition. However, conventional XRF-based pigment identification relies…
▽ More
X-ray fluorescence spectroscopy (XRF) plays an important role for elemental analysis in a wide range of scientific fields, especially in cultural heritage. XRF imaging, which uses a raster scan to acquire spectra across artworks, provides the opportunity for spatial analysis of pigment distributions based on their elemental composition. However, conventional XRF-based pigment identification relies on time-consuming elemental mapping by expert interpretations of measured spectra. To reduce the reliance on manual work, recent studies have applied machine learning techniques to cluster similar XRF spectra in data analysis and to identify the most likely pigments. Nevertheless, it is still challenging for automatic pigment identification strategies to directly tackle the complex structure of real paintings, e.g. pigment mixtures and layered pigments. In addition, pixel-wise pigment identification based on XRF imaging remains an obstacle due to the high noise level compared with averaged spectra. Therefore, we developed a deep-learning-based end-to-end pigment identification framework to fully automate the pigment identification process. In particular, it offers high sensitivity to the underlying pigments and to the pigments with a low concentration, therefore enabling satisfying results in mapping the pigments based on single-pixel XRF spectrum. As case studies, we applied our framework to lab-prepared mock-up paintings and two 19th-century paintings: Paul Gauguin's Poèmes Barbares (1896) that contains layered pigments with an underlying painting, and Paul Cezanne's The Bathers (1899-1904). The pigment identification results demonstrated that our model achieved comparable results to the analysis by elemental mapping, suggesting the generalizability and stability of our model.
△ Less
Submitted 26 July, 2022;
originally announced July 2022.
-
SkinScan: Low-Cost 3D-Scanning for Dermatologic Diagnosis and Documentation
Authors:
Merlin A. Nau,
Florian Schiffers,
Yunhao Li,
Bingjie Xu,
Andreas Maier,
Jack Tumblin,
Marc Walton,
Aggelos K. Katsaggelos,
Florian Willomitzer,
Oliver Cossairt
Abstract:
The utilization of computational photography becomes increasingly essential in the medical field. Today, imaging techniques for dermatology range from two-dimensional (2D) color imagery with a mobile device to professional clinical imaging systems measuring additional detailed three-dimensional (3D) data. The latter are commonly expensive and not accessible to a broad audience. In this work, we pr…
▽ More
The utilization of computational photography becomes increasingly essential in the medical field. Today, imaging techniques for dermatology range from two-dimensional (2D) color imagery with a mobile device to professional clinical imaging systems measuring additional detailed three-dimensional (3D) data. The latter are commonly expensive and not accessible to a broad audience. In this work, we propose a novel system and software framework that relies only on low-cost (and even mobile) commodity devices present in every household to measure detailed 3D information of the human skin with a 3D-gradient-illumination-based method. We believe that our system has great potential for early-stage diagnosis and monitoring of skin diseases, especially in vastly populated or underdeveloped areas.
△ Less
Submitted 31 January, 2021;
originally announced February 2021.
-
Exploiting wavelength diversity for high resolution time-of-flight 3D imaging
Authors:
Fengqiang Li,
Florian Willomitzer,
Prasanna Rangarajan,
Oliver Cossairt
Abstract:
State-of-the-art time-of-flight (ToF) based 3D sensors suffer from poor lateral and depth resolutions. In this work, we introduce a novel sensor concept that provides ToF-based 3D measurements of real world objects with depth precisions up to 35 micrometers and point cloud densities at the native sensor-resolutions of state-of-the-art CMOS/CCD cameras (up to several megapixels). Unlike other conti…
▽ More
State-of-the-art time-of-flight (ToF) based 3D sensors suffer from poor lateral and depth resolutions. In this work, we introduce a novel sensor concept that provides ToF-based 3D measurements of real world objects with depth precisions up to 35 micrometers and point cloud densities at the native sensor-resolutions of state-of-the-art CMOS/CCD cameras (up to several megapixels). Unlike other continuous-wave amplitude-modulated ToF principles, our approach exploits wavelength diversity for an interferometric surface measurement of macroscopic objects with rough or specular surfaces. Based on this principle, we introduce three different embodiments of prototype sensors, exploiting three different sensor architectures.
△ Less
Submitted 13 October, 2020;
originally announced October 2020.
-
Intensity interferometry-based 3D imaging
Authors:
Fabian Wagner,
Florian Schiffers,
Florian Willomitzer,
Oliver Cossairt,
Andreas Velten
Abstract:
The development of single-photon counting detectors and arrays has made tremendous steps in recent years, not the least because of various new applications in, e.g., LIDAR devices. In this work, a 3D imaging device based on real thermal light intensity interferometry is presented. By using gated SPAD technology, a basic 3D scene is imaged in reasonable measurement time. Compared to conventional ap…
▽ More
The development of single-photon counting detectors and arrays has made tremendous steps in recent years, not the least because of various new applications in, e.g., LIDAR devices. In this work, a 3D imaging device based on real thermal light intensity interferometry is presented. By using gated SPAD technology, a basic 3D scene is imaged in reasonable measurement time. Compared to conventional approaches, the proposed synchronized photon counting allows using more light modes to enhance 3D ranging performance. Advantages like robustness to atmospheric scattering or autonomy by exploiting external light sources can make this ranging approach interesting for future applications.
△ Less
Submitted 8 October, 2020;
originally announced October 2020.
