-
A multi-scale loss formulation for learning a probabilistic model with proper score optimisation
Authors:
Simon Lang,
Martin Leutbecher,
Pedro Maciel
Abstract:
We assess the impact of a multi-scale loss formulation for training probabilistic machine-learned weather forecasting models. The multi-scale loss is tested in AIFS-CRPS, a machine-learned weather forecasting model developed at the European Centre for Medium-Range Weather Forecasts (ECMWF). AIFS-CRPS is trained by directly optimising the almost fair continuous ranked probability score (afCRPS). Th…
▽ More
We assess the impact of a multi-scale loss formulation for training probabilistic machine-learned weather forecasting models. The multi-scale loss is tested in AIFS-CRPS, a machine-learned weather forecasting model developed at the European Centre for Medium-Range Weather Forecasts (ECMWF). AIFS-CRPS is trained by directly optimising the almost fair continuous ranked probability score (afCRPS). The multi-scale loss better constrains small scale variability without negatively impacting forecast skill. This opens up promising directions for future work in scale-aware model training.
△ Less
Submitted 12 June, 2025;
originally announced June 2025.
-
Inkspot: A stress-resilient, anthocyanin rich, dwarf tomato variant for off-world cultivation
Authors:
Sarah Lang,
A'nya Buckner,
Solomon Jones,
Gabrielle Erwin,
Sally Lee,
Rafael Loureiro
Abstract:
As humanity prepares for sustained off-world habitation, the development of regolith-based agriculture (RBA) is essential for achieving self-sufficiency in space crop production. However, lunar regolith's alkaline pH, poor water retention, and high metal content pose severe physiological and biochemical challenges to plant growth. This study evaluates the performance of Solanum lycopersicum 'Inksp…
▽ More
As humanity prepares for sustained off-world habitation, the development of regolith-based agriculture (RBA) is essential for achieving self-sufficiency in space crop production. However, lunar regolith's alkaline pH, poor water retention, and high metal content pose severe physiological and biochemical challenges to plant growth. This study evaluates the performance of Solanum lycopersicum 'Inkspot', a stress-adaptive, anthocyanin-rich tomato variant, in comparison to its progenitor 'Tiny Tim', under control and simulated lunar regolith (LHS-2) conditions. A randomized complete block design was used to assess germination dynamics, morphology, fruit quality, antioxidant activity, and root architecture across 80 replicates over 65 days in controlled chambers. Inkspot maintained high germination rates (85% in regolith) with low variation (CV = 14%) and showed only moderate reductions in height and biomass, while Tiny Tim suffered a 45% biomass reduction and 60% fruit yield loss. Inkspot fruits increased anthocyanin content 2.5-fold in regolith, functioning as a stress-response mechanism and potential bioindicator. Physiological assessments revealed greater retention of chlorophyll, Fv/Fm efficiency, and stomatal conductance in Inkspot, correlated with higher SOD and CAT enzyme activity and lower lipid peroxidation. Root imaging showed Inkspot developed a significantly larger, more complex root system, while Tiny Tim's roots contracted under stress. These findings highlight Inkspot's abiotic stress tolerance and potential as a candidate for closed-loop life support and in-situ resource utilization strategies in RBA systems.
△ Less
Submitted 23 May, 2025; v1 submitted 22 May, 2025;
originally announced May 2025.
-
Physiological and Transcriptional Responses of Arabidopsis thaliana to Simulated Lunar and Martian Regolith Substrates
Authors:
A'nya Buckner,
Sarah Lang,
Rafael Loureiro
Abstract:
The integration of plant-based bioregenerative life support systems is a central objective in NASA's Moon to Mars strategy. Arabidopsis thaliana, a model organism with extensive genomic resources, serves as a key species to investigate plant resilience in extraterrestrial environments. We assessed the physiological and gene expression responses of A. thaliana (Col-0) grown in two off-world regolit…
▽ More
The integration of plant-based bioregenerative life support systems is a central objective in NASA's Moon to Mars strategy. Arabidopsis thaliana, a model organism with extensive genomic resources, serves as a key species to investigate plant resilience in extraterrestrial environments. We assessed the physiological and gene expression responses of A. thaliana (Col-0) grown in two off-world regolith simulants: LHS-2 (lunar highlands) and MGS-1 (Martian global). Plants exposed to these substrates exhibited significant reductions in root elongation, biomass, and chlorophyll content, along with elevated anthocyanin levels and transcriptional upregulation of stress-related genes including IRT1, PCS1, SOD1, and JAZ1. Evidence of jasmonic acid pathway activation and auxin signaling suppression suggests metal-induced hormonal misregulation. Our integrated analysis of morphological traits, pigment accumulation, and transcriptomic profiles reveals distinct mineral-specific stress responses, offering critical insights into substrate engineering strategies for future space agriculture.
△ Less
Submitted 19 May, 2025;
originally announced May 2025.
-
CMOS-Compatible, Wafer-Scale Processed Superconducting Qubits Exceeding Energy Relaxation Times of 200us
Authors:
T. Mayer,
J. Weber,
E. Music,
C. Moran Guizan,
S. J. K. Lang,
L. Schwarzenbach,
C. Dhieb,
B. Kiliclar,
A. Maiwald,
Z. Luo,
W. Lerch,
D. Zahn,
I. Eisele,
R. N. Pereira,
C. Kutter
Abstract:
We present the results of an industry-grade fabrication of superconducting qubits on 200 mm wafers utilizing CMOS-established processing methods. By automated waferprober resistance measurements at room temperature, we demonstrate a Josephson junction fabrication yield of 99.7% (shorts and opens) across more than 10000 junctions and a qubit frequency prediction accuracy of 1.6%. In cryogenic chara…
▽ More
We present the results of an industry-grade fabrication of superconducting qubits on 200 mm wafers utilizing CMOS-established processing methods. By automated waferprober resistance measurements at room temperature, we demonstrate a Josephson junction fabrication yield of 99.7% (shorts and opens) across more than 10000 junctions and a qubit frequency prediction accuracy of 1.6%. In cryogenic characterization, we provide statistical results regarding energy relaxation times of the qubits with a median T1 of up to 100 us and individual devices consistently approaching 200 us in long-term measurements. This represents the best performance reported so far for superconducting qubits fabricated by industry-grade, wafer-level subtractive processes.
△ Less
Submitted 20 May, 2025; v1 submitted 13 May, 2025;
originally announced May 2025.
-
3D-Integrated Superconducting qubits: CMOS-Compatible, Wafer-Scale Processing for Flip-Chip Architectures
Authors:
T. Mayer,
H. Bender,
S. J. K. Lang,
Z. Luo,
J. Weber,
C. Moran Guizan,
C. Dhieb,
D. Zahn,
L. Schwarzenbach,
W. Hell,
M. Andronic,
A. Drost,
K. Neumeier,
W. Lerch,
L. Nebrich,
A. Hagelauer,
I. Eisele,
R. N. Pereira,
C. Kutter
Abstract:
In this article, we present a technology development of a superconducting qubit device 3D-integrated by flip-chip-bonding and processed following CMOS fabrication standards and contamination rules on 200 mm wafers. We present the utilized proof-of-concept chip designs for qubit- and carrier chip, as well as the respective front-end and back-end fabrication techniques. In characterization of the ne…
▽ More
In this article, we present a technology development of a superconducting qubit device 3D-integrated by flip-chip-bonding and processed following CMOS fabrication standards and contamination rules on 200 mm wafers. We present the utilized proof-of-concept chip designs for qubit- and carrier chip, as well as the respective front-end and back-end fabrication techniques. In characterization of the newly developed microbump technology based on metallized KOH-etched Si-islands, we observe a superconducting transition of the used metal stacks and radio frequency (RF) signal transfer through the bump connection with negligible attenuation. In time-domain spectroscopy of the qubits we find high yield qubit excitation with energy relaxation times of up to 15 us.
△ Less
Submitted 23 May, 2025; v1 submitted 7 May, 2025;
originally announced May 2025.
-
Advancing Superconducting Qubits: CMOS-Compatible Processing and Room Temperature Characterization for Scalable Quantum Computing beyond 2D Architectures
Authors:
S. J. K. Lang,
T. Mayer,
J. Weber,
C. Dhieb,
I. Eisele,
W. Lerch,
Z. Luo,
C. Moran Guizan,
E. Music,
L. Sturm-Rogon,
D. Zahn,
R. N. Pereira,
C. Kutter
Abstract:
We report on an industry-grade CMOS-compatible qubit fabrication approach using a CMOS pilot line, enabling a yield of functional devices reaching 92.8%, with a resistance spread evaluated across the full wafer 200 mm diameter of 12.4% and relaxation times (T1) approaching 80 us. Furthermore, we conducted a comprehensive analysis of wafer-scale room temperature (RT) characteristics collected from…
▽ More
We report on an industry-grade CMOS-compatible qubit fabrication approach using a CMOS pilot line, enabling a yield of functional devices reaching 92.8%, with a resistance spread evaluated across the full wafer 200 mm diameter of 12.4% and relaxation times (T1) approaching 80 us. Furthermore, we conducted a comprehensive analysis of wafer-scale room temperature (RT) characteristics collected from multiple wafers and fabrication runs, focusing on RT measurements and their correlation to low temperature qubit parameters. From defined test structures, a across-wafer junction area variation of 10.1% and oxide barrier variation of 7.2% was calculated. Additionally, we notably show a close-correlation between qubit junction resistance and frequency in accordance with the Ambegaokar-Baratoff relation with a critical temperature Tc of about 0.71 K. This overarching relation sets the stage for pre-cooldown qubit evaluation and sorting. In particular, such early-on device characterization and validation are crucial for increasing the fabrication yield and qubit frequency targeting, which currently represent major scaling challenges. Furthermore, it enables the fabrication of large multichip quantum systems in the future. Our findings highlight the great potential of CMOS-compatible industry-style fabrication of superconducting qubits for scalable quantum computing in a foundry pilot line cleanroom.
△ Less
Submitted 26 May, 2025; v1 submitted 25 April, 2025;
originally announced April 2025.
-
Wafer-Scale Characterization of Al/AlxOy/Al Josephson Junctions at Room Temperature
Authors:
Simon J. K. Lang,
Ignaz Eisele,
Johannes Weber,
Alexandra Schewski,
Emir Music,
Alwin Maiwald,
Martin Heigl,
Daniela Zahn,
Zhen Luo,
Lars Nebrich,
Benedikt Schoof,
Thomas Mayer,
Leonhard Sturm-Rogon,
Wilfried Lerch,
Rui N. Pereira,
Christoph Kutter
Abstract:
Josephson junctions (JJs) are the key element of many devices operating at cryogenic temperatures. Development of time-efficient wafer-scale JJ characterization for process optimization and control of JJ fabrication is essential. Such statistical characterization has to rely on room temperature techniques since cryogenic measurements typically used for JJs are too time consuming and unsuitable for…
▽ More
Josephson junctions (JJs) are the key element of many devices operating at cryogenic temperatures. Development of time-efficient wafer-scale JJ characterization for process optimization and control of JJ fabrication is essential. Such statistical characterization has to rely on room temperature techniques since cryogenic measurements typically used for JJs are too time consuming and unsuitable for wafer-scale characterization. In this work, we show that from room temperature capacitance and current-voltage measurements, with proper data analysis, we can independently obtain useful parameters of the JJs on wafer-scale, like oxide thickness, tunnel coefficient, and interfacial defect densities. Moreover, based on detailed analysis of current vs voltage characteristics, different charge transport mechanisms across the junctions can be distinguished. We exemplary demonstrate the worth of these methods by studying junctions fabricated on 200 mm wafers with an industrially scale-able concept based on subtractive processing using only CMOS compatible tools. From these studies, we find that our subtractive fabrication approach yields junctions with quite homogeneous average oxide thickness across the full wafers, with a spread of less then 3$\,$%. The analysis also revealed a variation of the tunnel coefficient with oxide thickness, pointing to a stoichiometry gradient across the junctions' oxide width. Moreover, we estimated relatively low interfacial defect densities in the range of 70 - 5000$\,$defects/cm$^2$ for our junctions and established that the density increased with decreasing oxide thickness, indicating that the wet etching process applied in the JJs fabrication for oxide thickness control leads to formation of interfacial trap state
△ Less
Submitted 14 May, 2025; v1 submitted 23 April, 2025;
originally announced April 2025.
-
Input to European Strategy Update for Particle Physics: Sustainability
Authors:
Veronique Boisvert,
Daniel Britzger,
Samuel Calvet,
Yann Coadou,
Caterina Doglioni,
Julien Faivre,
Patrick Koppenburg,
Valerie S. Lang,
Kristin Lohwasser,
Zach Marshall,
Rakhi Mahbubani,
Peter Millington,
Tomoko Muranaka,
Karolos Potamianos,
Ruth Pöttgen,
Hannah Wakeling,
Efe Yazgan
Abstract:
Human activity continues to have an enormous negative impact on the ability of the planet to sustain human and other forms of life. Six out of the nine planetary boundaries have been crossed, a seventh is close to threshold. Prominent manifestations of this development are climate change caused by greenhouse gas emissions, as well as loss of biodiversity. In recognition of the urgency of these pro…
▽ More
Human activity continues to have an enormous negative impact on the ability of the planet to sustain human and other forms of life. Six out of the nine planetary boundaries have been crossed, a seventh is close to threshold. Prominent manifestations of this development are climate change caused by greenhouse gas emissions, as well as loss of biodiversity. In recognition of the urgency of these problems, several international agreements have been ratified to achieve net-zero emissions and to halt and reverse biodiversity loss. Significant reductions in emissions are required by 2030 to meet international climate targets. The field of particle physics has an obligation and an opportunity to contribute to such mitigation efforts and to avoid causing further harm. This document urges the European Strategy Update in Particle Physics to set a clear and bold mandate for embedding environmental sustainability throughout the future scientific programme, and advocates for a series of actions that will enable this.
△ Less
Submitted 3 April, 2025;
originally announced April 2025.
-
Percolation of both signs in a triangular-type 3D Ising model above $T_c$
Authors:
Jianping Jiang,
Sike Lang
Abstract:
Let $\mathbb{T}$ be the two-dimensional triangular lattice, and $\mathbb{Z}$ the one-dimensional integer lattice. Let $\mathbb{T}\times \mathbb{Z}$ denote the Cartesian product graph. Consider the Ising model defined on this graph with inverse temperature $β$ and external field $h$, and let $β_c$ be the critical inverse temperature when $h=0$. We prove that for each $β\in[0,β_c)$, there exists…
▽ More
Let $\mathbb{T}$ be the two-dimensional triangular lattice, and $\mathbb{Z}$ the one-dimensional integer lattice. Let $\mathbb{T}\times \mathbb{Z}$ denote the Cartesian product graph. Consider the Ising model defined on this graph with inverse temperature $β$ and external field $h$, and let $β_c$ be the critical inverse temperature when $h=0$. We prove that for each $β\in[0,β_c)$, there exists $h_c(β)>0$ such that both a unique infinite $+$cluster and a unique infinite $-$cluster coexist whenever $|h|<h_c(β)$. The same coexistence result also holds for the three-dimensional triangular lattice.
△ Less
Submitted 27 March, 2025;
originally announced March 2025.
-
AIFS-CRPS: Ensemble forecasting using a model trained with a loss function based on the Continuous Ranked Probability Score
Authors:
Simon Lang,
Mihai Alexe,
Mariana C. A. Clare,
Christopher Roberts,
Rilwan Adewoyin,
Zied Ben Bouallègue,
Matthew Chantry,
Jesper Dramsch,
Peter D. Dueben,
Sara Hahner,
Pedro Maciel,
Ana Prieto-Nemesio,
Cathal O'Brien,
Florian Pinault,
Jan Polster,
Baudouin Raoult,
Steffen Tietsche,
Martin Leutbecher
Abstract:
Over the last three decades, ensemble forecasts have become an integral part of forecasting the weather. They provide users with more complete information than single forecasts as they permit to estimate the probability of weather events by representing the sources of uncertainties and accounting for the day-to-day variability of error growth in the atmosphere. This paper presents a novel approach…
▽ More
Over the last three decades, ensemble forecasts have become an integral part of forecasting the weather. They provide users with more complete information than single forecasts as they permit to estimate the probability of weather events by representing the sources of uncertainties and accounting for the day-to-day variability of error growth in the atmosphere. This paper presents a novel approach to obtain a weather forecast model for ensemble forecasting with machine-learning. AIFS-CRPS is a variant of the Artificial Intelligence Forecasting System (AIFS) developed at ECMWF. Its loss function is based on a proper score, the Continuous Ranked Probability Score (CRPS). For the loss, the almost fair CRPS is introduced because it approximately removes the bias in the score due to finite ensemble size yet avoids a degeneracy of the fair CRPS. The trained model is stochastic and can generate as many exchangeable members as desired and computationally feasible in inference. For medium-range forecasts AIFS-CRPS outperforms the physics-based Integrated Forecasting System (IFS) ensemble for the majority of variables and lead times. For subseasonal forecasts, AIFS-CRPS outperforms the IFS ensemble before calibration and is competitive with the IFS ensemble when forecasts are evaluated as anomalies to remove the influence of model biases.
△ Less
Submitted 20 December, 2024;
originally announced December 2024.
-
GraphDOP: Towards skilful data-driven medium-range weather forecasts learnt and initialised directly from observations
Authors:
Mihai Alexe,
Eulalie Boucher,
Peter Lean,
Ewan Pinnington,
Patrick Laloyaux,
Anthony McNally,
Simon Lang,
Matthew Chantry,
Chris Burrows,
Marcin Chrust,
Florian Pinault,
Ethel Villeneuve,
Niels Bormann,
Sean Healy
Abstract:
We introduce GraphDOP, a new data-driven, end-to-end forecast system developed at the European Centre for Medium-Range Weather Forecasts (ECMWF) that is trained and initialised exclusively from Earth System observations, with no physics-based (re)analysis inputs or feedbacks. GraphDOP learns the correlations between observed quantities - such as brightness temperatures from polar orbiters and geos…
▽ More
We introduce GraphDOP, a new data-driven, end-to-end forecast system developed at the European Centre for Medium-Range Weather Forecasts (ECMWF) that is trained and initialised exclusively from Earth System observations, with no physics-based (re)analysis inputs or feedbacks. GraphDOP learns the correlations between observed quantities - such as brightness temperatures from polar orbiters and geostationary satellites - and geophysical quantities of interest (that are measured by conventional observations), to form a coherent latent representation of Earth System state dynamics and physical processes, and is capable of producing skilful predictions of relevant weather parameters up to five days into the future.
△ Less
Submitted 20 December, 2024;
originally announced December 2024.
-
Robust performance for switched systems with constrained switching and its application to weakly hard real-time control systems
Authors:
Simon Lang,
Marc Seidel,
Frank Allgöwer
Abstract:
Many cyber-physical systems can naturally be formulated as switched systems with constrained switching. This includes systems where one of the signals in the feedback loop may be lost. Possible sources for losses are shared or unreliable communication media in networked control systems, or signals which are discarded, e.g., when using a shared computation device such as a processor in real-time co…
▽ More
Many cyber-physical systems can naturally be formulated as switched systems with constrained switching. This includes systems where one of the signals in the feedback loop may be lost. Possible sources for losses are shared or unreliable communication media in networked control systems, or signals which are discarded, e.g., when using a shared computation device such as a processor in real-time control applications. The use of switched systems with constrained switching is not limited to cyber-physical systems but, includes many other relevant applications such as power systems and modeling virus mutations. In this chapter, we introduce a framework for analyzing and designing controllers which guarantee robust quadratic performance for switched systems with constrained switching. The possible switching sequences are described by the language of a labeled graph where the labels are linked to the different subsystems. The subsystems are allowed to have different input and output dimensions, and their state-space representations can be affected by a broad class of uncertainties in a rational way. The proposed framework exploits ideas from dissipativity-based linear control theory to derive analysis and synthesis inequalities given by linear matrix inequalities. We demonstrate how the proposed framework can be applied to the design of controllers for uncertain weakly hard real-time control systems - a system class naturally appearing in networked and real-time control.
△ Less
Submitted 13 November, 2024;
originally announced November 2024.
-
Development of TiN/AlN-based superconducting qubit components
Authors:
Benedikt Schoof,
Moritz Singer,
Simon Lang,
Harsh Gupta,
Daniela Zahn,
Johannes Weber,
Marc Tornow
Abstract:
This paper presents the fabrication and characterization of superconducting qubit components from titanium nitride (TiN) and aluminum nitride (AlN) layers to create Josephson junctions and superconducting resonators in an all-nitride architecture. Our methodology comprises a complete process flow for the fabrication of TiN/AlN/TiN junctions, characterized by scanning electron microscopy (SEM), ato…
▽ More
This paper presents the fabrication and characterization of superconducting qubit components from titanium nitride (TiN) and aluminum nitride (AlN) layers to create Josephson junctions and superconducting resonators in an all-nitride architecture. Our methodology comprises a complete process flow for the fabrication of TiN/AlN/TiN junctions, characterized by scanning electron microscopy (SEM), atomic force microscopy (AFM), ellipsometry and DC electrical measurements. We evaluated the sputtering rates of AlN under varied conditions, the critical temperatures of TiN thin films for different sputtering environments, and the internal quality factors of TiN resonators in the few-GHz regime, fabricated from these films. Overall, this offered insights into the material properties critical to qubit performance. Measurements of the dependence of the critical current of the TiN / AlN / TiN junctions yielded values ranging from 150 $μ$A to 2 $μ$A, for AlN barrier thicknesses up to ca. 5 nm, respectively. Our findings demonstrate advances in the fabrication of nitride-based superconducting qubit components, which may find applications in quantum computing technologies based on novel materials.
△ Less
Submitted 11 September, 2024;
originally announced September 2024.
-
Regional data-driven weather modeling with a global stretched-grid
Authors:
Thomas Nils Nipen,
Håvard Homleid Haugen,
Magnus Sikora Ingstad,
Even Marius Nordhagen,
Aram Farhad Shafiq Salihi,
Paulina Tedesco,
Ivar Ambjørn Seierstad,
Jørn Kristiansen,
Simon Lang,
Mihai Alexe,
Jesper Dramsch,
Baudouin Raoult,
Gert Mertes,
Matthew Chantry
Abstract:
A data-driven model (DDM) suitable for regional weather forecasting applications is presented. The model extends the Artificial Intelligence Forecasting System by introducing a stretched-grid architecture that dedicates higher resolution over a regional area of interest and maintains a lower resolution elsewhere on the globe. The model is based on graph neural networks, which naturally affords arb…
▽ More
A data-driven model (DDM) suitable for regional weather forecasting applications is presented. The model extends the Artificial Intelligence Forecasting System by introducing a stretched-grid architecture that dedicates higher resolution over a regional area of interest and maintains a lower resolution elsewhere on the globe. The model is based on graph neural networks, which naturally affords arbitrary multi-resolution grid configurations.
The model is applied to short-range weather prediction for the Nordics, producing forecasts at 2.5 km spatial and 6 h temporal resolution. The model is pre-trained on 43 years of global ERA5 data at 31 km resolution and is further refined using 3.3 years of 2.5 km resolution operational analyses from the MetCoOp Ensemble Prediction System (MEPS). The performance of the model is evaluated using surface observations from measurement stations across Norway and is compared to short-range weather forecasts from MEPS. The DDM outperforms both the control run and the ensemble mean of MEPS for 2 m temperature. The model also produces competitive precipitation and wind speed forecasts, but is shown to underestimate extreme events.
△ Less
Submitted 4 September, 2024;
originally announced September 2024.
-
Data driven weather forecasts trained and initialised directly from observations
Authors:
Anthony McNally,
Christian Lessig,
Peter Lean,
Eulalie Boucher,
Mihai Alexe,
Ewan Pinnington,
Matthew Chantry,
Simon Lang,
Chris Burrows,
Marcin Chrust,
Florian Pinault,
Ethel Villeneuve,
Niels Bormann,
Sean Healy
Abstract:
Skilful Machine Learned weather forecasts have challenged our approach to numerical weather prediction, demonstrating competitive performance compared to traditional physics-based approaches. Data-driven systems have been trained to forecast future weather by learning from long historical records of past weather such as the ECMWF ERA5. These datasets have been made freely available to the wider re…
▽ More
Skilful Machine Learned weather forecasts have challenged our approach to numerical weather prediction, demonstrating competitive performance compared to traditional physics-based approaches. Data-driven systems have been trained to forecast future weather by learning from long historical records of past weather such as the ECMWF ERA5. These datasets have been made freely available to the wider research community, including the commercial sector, which has been a major factor in the rapid rise of ML forecast systems and the levels of accuracy they have achieved. However, historical reanalyses used for training and real-time analyses used for initial conditions are produced by data assimilation, an optimal blending of observations with a physics-based forecast model. As such, many ML forecast systems have an implicit and unquantified dependence on the physics-based models they seek to challenge. Here we propose a new approach, training a neural network to predict future weather purely from historical observations with no dependence on reanalyses. We use raw observations to initialise a model of the atmosphere (in observation space) learned directly from the observations themselves. Forecasts of crucial weather parameters (such as surface temperature and wind) are obtained by predicting weather parameter observations (e.g. SYNOP surface data) at future times and arbitrary locations. We present preliminary results on forecasting observations 12-hours into the future. These already demonstrate successful learning of time evolutions of the physical processes captured in real observations. We argue that this new approach, by staying purely in observation space, avoids many of the challenges of traditional data assimilation, can exploit a wider range of observations and is readily expanded to simultaneous forecasting of the full Earth system (atmosphere, land, ocean and composition).
△ Less
Submitted 22 July, 2024;
originally announced July 2024.
-
AIFS -- ECMWF's data-driven forecasting system
Authors:
Simon Lang,
Mihai Alexe,
Matthew Chantry,
Jesper Dramsch,
Florian Pinault,
Baudouin Raoult,
Mariana C. A. Clare,
Christian Lessig,
Michael Maier-Gerber,
Linus Magnusson,
Zied Ben Bouallègue,
Ana Prieto Nemesio,
Peter D. Dueben,
Andrew Brown,
Florian Pappenberger,
Florence Rabier
Abstract:
Machine learning-based weather forecasting models have quickly emerged as a promising methodology for accurate medium-range global weather forecasting. Here, we introduce the Artificial Intelligence Forecasting System (AIFS), a data driven forecast model developed by the European Centre for Medium-Range Weather Forecasts (ECMWF). AIFS is based on a graph neural network (GNN) encoder and decoder, a…
▽ More
Machine learning-based weather forecasting models have quickly emerged as a promising methodology for accurate medium-range global weather forecasting. Here, we introduce the Artificial Intelligence Forecasting System (AIFS), a data driven forecast model developed by the European Centre for Medium-Range Weather Forecasts (ECMWF). AIFS is based on a graph neural network (GNN) encoder and decoder, and a sliding window transformer processor, and is trained on ECMWF's ERA5 re-analysis and ECMWF's operational numerical weather prediction (NWP) analyses. It has a flexible and modular design and supports several levels of parallelism to enable training on high-resolution input data. AIFS forecast skill is assessed by comparing its forecasts to NWP analyses and direct observational data. We show that AIFS produces highly skilled forecasts for upper-air variables, surface weather parameters and tropical cyclone tracks. AIFS is run four times daily alongside ECMWF's physics-based NWP model and forecasts are available to the public under ECMWF's open data policy.
△ Less
Submitted 7 August, 2024; v1 submitted 3 June, 2024;
originally announced June 2024.
-
Know your footprint -- Evaluation of the professional carbon footprint for individual researchers in high energy physics and related fields
Authors:
Valerie S. Lang,
Naman Kumar Bhalla,
Simran Sunil Gurdasani,
Pardis Niknejadi
Abstract:
As the climate crisis intensifies, understanding the environmental impact of professional activities is paramount, especially in sectors with historically significant resource utilisation. This includes High Energy Physics (HEP) and related fields, which investigate the fundamental laws of our universe. As members of the young High Energy Physicists (yHEP) association, we investigate the CO$_2$-eq…
▽ More
As the climate crisis intensifies, understanding the environmental impact of professional activities is paramount, especially in sectors with historically significant resource utilisation. This includes High Energy Physics (HEP) and related fields, which investigate the fundamental laws of our universe. As members of the young High Energy Physicists (yHEP) association, we investigate the CO$_2$-equivalent emissions generated by HEP-related research on a personalised per-researcher level, for four distinct categories: Experiments, tied to collaborations with substantial infrastructure; Institutional, representing the resource consumption of research institutes and universities; Computing, focussing on simulations and data analysis; and Travel, covering professional trips to conferences, etc. The findings are integrated into a tool for self-evaluation, the Know-your-footprint (Kyf) calculator, allowing the assessment of the personal and professional footprint and optionally sharing the data with the yHEP association. The study aims to heighten awareness, foster sustainability, and inspire the community to adopt more environmentally responsible research practices urgently.
△ Less
Submitted 9 April, 2025; v1 submitted 5 March, 2024;
originally announced March 2024.
-
Learning dynamic representations of the functional connectome in neurobiological networks
Authors:
Luciano Dyballa,
Samuel Lang,
Alexandra Haslund-Gourley,
Eviatar Yemini,
Steven W. Zucker
Abstract:
The static synaptic connectivity of neuronal circuits stands in direct contrast to the dynamics of their function. As in changing community interactions, different neurons can participate actively in various combinations to effect behaviors at different times. We introduce an unsupervised approach to learn the dynamic affinities between neurons in live, behaving animals, and to reveal which commun…
▽ More
The static synaptic connectivity of neuronal circuits stands in direct contrast to the dynamics of their function. As in changing community interactions, different neurons can participate actively in various combinations to effect behaviors at different times. We introduce an unsupervised approach to learn the dynamic affinities between neurons in live, behaving animals, and to reveal which communities form among neurons at different times. The inference occurs in two major steps. First, pairwise non-linear affinities between neuronal traces from brain-wide calcium activity are organized by non-negative tensor factorization (NTF). Each factor specifies which groups of neurons are most likely interacting for an inferred interval in time, and for which animals. Finally, a generative model that allows for weighted community detection is applied to the functional motifs produced by NTF to reveal a dynamic functional connectome. Since time codes the different experimental variables (e.g., application of chemical stimuli), this provides an atlas of neural motifs active during separate stages of an experiment (e.g., stimulus application or spontaneous behaviors). Results from our analysis are experimentally validated, confirming that our method is able to robustly predict causal interactions between neurons to generate behavior. Code is available at https://github.com/dyballa/dynamic-connectomes.
△ Less
Submitted 27 February, 2024; v1 submitted 21 February, 2024;
originally announced February 2024.
-
Diving with Penguins: Detecting Penguins and their Prey in Animal-borne Underwater Videos via Deep Learning
Authors:
Kejia Zhang,
Mingyu Yang,
Stephen D. J. Lang,
Alistair M. McInnes,
Richard B. Sherley,
Tilo Burghardt
Abstract:
African penguins (Spheniscus demersus) are an endangered species. Little is known regarding their underwater hunting strategies and associated predation success rates, yet this is essential for guiding conservation. Modern bio-logging technology has the potential to provide valuable insights, but manually analysing large amounts of data from animal-borne video recorders (AVRs) is time-consuming. I…
▽ More
African penguins (Spheniscus demersus) are an endangered species. Little is known regarding their underwater hunting strategies and associated predation success rates, yet this is essential for guiding conservation. Modern bio-logging technology has the potential to provide valuable insights, but manually analysing large amounts of data from animal-borne video recorders (AVRs) is time-consuming. In this paper, we publish an animal-borne underwater video dataset of penguins and introduce a ready-to-deploy deep learning system capable of robustly detecting penguins ([email protected]%) and also instances of fish ([email protected]%). We note that the detectors benefit explicitly from air-bubble learning to improve accuracy. Extending this detector towards a dual-stream behaviour recognition network, we also provide the first results for identifying predation behaviour in penguin underwater videos. Whilst results are promising, further work is required for useful applicability of predation behaviour detection in field scenarios. In summary, we provide a highly reliable underwater penguin detector, a fish detector, and a valuable first attempt towards an automated visual detection of complex behaviours in a marine predator. We publish the networks, the DivingWithPenguins video dataset, annotations, splits, and weights for full reproducibility and immediate usability by practitioners.
△ Less
Submitted 14 August, 2023;
originally announced August 2023.
-
The rise of data-driven weather forecasting
Authors:
Zied Ben-Bouallegue,
Mariana C A Clare,
Linus Magnusson,
Estibaliz Gascon,
Michael Maier-Gerber,
Martin Janousek,
Mark Rodwell,
Florian Pinault,
Jesper S Dramsch,
Simon T K Lang,
Baudouin Raoult,
Florence Rabier,
Matthieu Chevallier,
Irina Sandu,
Peter Dueben,
Matthew Chantry,
Florian Pappenberger
Abstract:
Data-driven modeling based on machine learning (ML) is showing enormous potential for weather forecasting. Rapid progress has been made with impressive results for some applications. The uptake of ML methods could be a game-changer for the incremental progress in traditional numerical weather prediction (NWP) known as the 'quiet revolution' of weather forecasting. The computational cost of running…
▽ More
Data-driven modeling based on machine learning (ML) is showing enormous potential for weather forecasting. Rapid progress has been made with impressive results for some applications. The uptake of ML methods could be a game-changer for the incremental progress in traditional numerical weather prediction (NWP) known as the 'quiet revolution' of weather forecasting. The computational cost of running a forecast with standard NWP systems greatly hinders the improvements that can be made from increasing model resolution and ensemble sizes. An emerging new generation of ML models, developed using high-quality reanalysis datasets like ERA5 for training, allow forecasts that require much lower computational costs and that are highly-competitive in terms of accuracy. Here, we compare for the first time ML-generated forecasts with standard NWP-based forecasts in an operational-like context, initialized from the same initial conditions. Focusing on deterministic forecasts, we apply common forecast verification tools to assess to what extent a data-driven forecast produced with one of the recently developed ML models (PanguWeather) matches the quality and attributes of a forecast from one of the leading global NWP systems (the ECMWF IFS). The results are very promising, with comparable skill for both global metrics and extreme events, when verified against both the operational analysis and synoptic observations. Increasing forecast smoothness and bias drift with forecast lead time are identified as current drawbacks of ML-based forecasts. A new NWP paradigm is emerging relying on inference from ML models and state-of-the-art analysis and reanalysis datasets for forecast initialization and model training.
△ Less
Submitted 3 November, 2023; v1 submitted 19 July, 2023;
originally announced July 2023.
-
On $\ell_2$-performance of weakly-hard real-time control systems
Authors:
Marc Seidel,
Simon Lang,
Frank Allgöwer
Abstract:
This paper considers control systems with failures in the feedback channel, that occasionally lead to loss of the control input signal. A useful approach for modeling such failures is to consider window-based constraints on possible loss sequences, for example that at least r control attempts in every window of s are successful. A powerful framework to model such constraints are weakly-hard real-t…
▽ More
This paper considers control systems with failures in the feedback channel, that occasionally lead to loss of the control input signal. A useful approach for modeling such failures is to consider window-based constraints on possible loss sequences, for example that at least r control attempts in every window of s are successful. A powerful framework to model such constraints are weakly-hard real-time constraints. Various approaches for stability analysis and the synthesis of stabilizing controllers for such systems have been presented in the past. However, existing results are mostly limited to asymptotic stability and rarely consider performance measures such as the resulting $\ell_2$-gain. To address this problem, we adapt a switched system description where the switching sequence is constrained by a graph that captures the loss information. We present an approach for $\ell_2$-performance analysis involving linear matrix inequalities (LMI). Further, leveraging a system lifting method, we propose an LMI-based approach for synthesizing state-feedback controllers with guaranteed $\ell_2$-performance. The results are illustrated by a numerical example.
△ Less
Submitted 12 June, 2024; v1 submitted 13 May, 2023;
originally announced May 2023.
-
Current Status of the Muon g-2 Interpretations within Two-Higgs-Doublet Models
Authors:
Syuhei Iguro,
Teppei Kitahara,
Martin S. Lang,
Michihisa Takeuchi
Abstract:
In this article, we review and update implications of the muon anomalous magnetic moment (muon $g-2$) anomaly for two-Higgs-doublet models (2HDMs), which are classified according to imposed symmetries and their resulting Yukawa sector. In the minimal setup, the muon $g-2$ anomaly can be accommodated by the type-X (lepto-philic) 2HDM, flavor-aligned 2HDM (FA2HDM), muon-specific 2HDM ($μ$2HDM), and…
▽ More
In this article, we review and update implications of the muon anomalous magnetic moment (muon $g-2$) anomaly for two-Higgs-doublet models (2HDMs), which are classified according to imposed symmetries and their resulting Yukawa sector. In the minimal setup, the muon $g-2$ anomaly can be accommodated by the type-X (lepto-philic) 2HDM, flavor-aligned 2HDM (FA2HDM), muon-specific 2HDM ($μ$2HDM), and $μτ$-flavor violating 2HDM. We summarize all relevant experimental constraints from high-energy collider experiments and flavor experiments, as well as the theoretical constraints from the perturbative unitarity and vacuum stability bounds, to these 2HDMs in light of the muon $g-2$ anomaly. We clarify the available parameter spaces of these 2HDMs and investigate how to probe the remaining parameter regions in future experiments. In particular, we find that, due to the updated $B_s\toμ^+ μ^-$ measurement, the remaining parameter region of the FA2HDM is almost equivalent to the one of the type-X 2HDM. Furthermore, based on collider simulations, we find that the type-X 2HDM is excluded and the $μ$2HDM scenario will be covered with the upcoming Run 3 data.
△ Less
Submitted 14 November, 2023; v1 submitted 19 April, 2023;
originally announced April 2023.
-
Facilitating deep acoustic phenotyping: A basic coding scheme of infant vocalisations preluding computational analysis, machine learning and clinical reasoning
Authors:
Tomas Kulvicius,
Sigrun Lang,
Claudius AA Widmann,
Nina Hansmann,
Daniel Holzinger,
Luise Poustka,
Dajie Zhang,
Peter B Marschik
Abstract:
Theoretical background: early verbal development is not yet fully understood, especially in its formative phase. Research question: can a reliable, easy-to-use coding scheme for the classification of early infant vocalizations be defined that is applicable as a basis for further analysis of language development? Methods: in a longitudinal study of 45 neurotypical infants, we analyzed vocalizations…
▽ More
Theoretical background: early verbal development is not yet fully understood, especially in its formative phase. Research question: can a reliable, easy-to-use coding scheme for the classification of early infant vocalizations be defined that is applicable as a basis for further analysis of language development? Methods: in a longitudinal study of 45 neurotypical infants, we analyzed vocalizations of the first 4 months of life. Audio segments were assigned to 5 classes: (1) Voiced and (2) Voiceless vocalizations; (3) Defined signal; (4) Non-target; (5) Nonassignable. Results: Two female coders with different experience achieved high agreement without intensive training. Discussion and Conclusion: The reliable scheme can be used in research and clinical settings for efficient coding of infant vocalizations, as a basis for detailed manual and machine analyses.
△ Less
Submitted 14 March, 2023;
originally announced March 2023.
-
"Spatial Joint Models through Bayesian Structured Piece-wise Additive Joint Modelling for Longitudinal and Time-to-Event Data"
Authors:
Anja Rappl,
Thomas Kneib,
Stefan Lang,
Elisabeth Bergherr
Abstract:
Joint models for longitudinal and time-to-event data have seen many developments in recent years. Though spatial joint models are still rare and the traditional proportional hazards formulation of the time-to-event part of the model is accompanied by computational challenges. We propose a joint model with a piece-wise exponential formulation of the hazard using the counting process representation…
▽ More
Joint models for longitudinal and time-to-event data have seen many developments in recent years. Though spatial joint models are still rare and the traditional proportional hazards formulation of the time-to-event part of the model is accompanied by computational challenges. We propose a joint model with a piece-wise exponential formulation of the hazard using the counting process representation of a hazard and structured additive predictors able to estimate (non-)linear, spatial and random effects. Its capabilities are assessed in a simulation study comparing our approach to an established one and highlighted by an example on physical functioning after cardiovascular events from the German Ageing Survey. The Structured Piecewise Additive Joint Model yielded good estimation performance, also and especially in spatial effects, while being double as fast as the chosen benchmark approach and performing stable in imbalanced data setting with few events.
△ Less
Submitted 14 February, 2023;
originally announced February 2023.
-
Scalable Estimation for Structured Additive Distributional Regression
Authors:
Nikolaus Umlauf,
Johannes Seiler,
Mattias Wetscher,
Thorsten Simon,
Stefan Lang,
Nadja Klein
Abstract:
Recently, fitting probabilistic models have gained importance in many areas but estimation of such distributional models with very large data sets is a difficult task. In particular, the use of rather complex models can easily lead to memory-related efficiency problems that can make estimation infeasible even on high-performance computers. We therefore propose a novel backfitting algorithm, which…
▽ More
Recently, fitting probabilistic models have gained importance in many areas but estimation of such distributional models with very large data sets is a difficult task. In particular, the use of rather complex models can easily lead to memory-related efficiency problems that can make estimation infeasible even on high-performance computers. We therefore propose a novel backfitting algorithm, which is based on the ideas of stochastic gradient descent and can deal virtually with any amount of data on a conventional laptop. The algorithm performs automatic selection of variables and smoothing parameters, and its performance is in most cases superior or at least equivalent to other implementations for structured additive distributional regression, e.g., gradient boosting, while maintaining low computation time. Performance is evaluated using an extensive simulation study and an exceptionally challenging and unique example of lightning count prediction over Austria. A very large dataset with over 9 million observations and 80 covariates is used, so that a prediction model cannot be estimated with standard distributional regression methods but with our new approach.
△ Less
Submitted 13 January, 2023;
originally announced January 2023.
-
$B_s \to μ^+ μ^-$ in a Two-Higgs-Doublet Model with flavour-changing up-type Yukawa couplings
Authors:
Martin S. Lang,
Ulrich Nierste
Abstract:
We present a Two-Higgs-Doublet Model in which the structure of the quark Yukawa matrices is governed by three spurions breaking the flavour symmetries of the quark Yukawa sector. The model naturally suppresses flavour-changing neutral current (FCNC) amplitudes in the down-type sector, but permits sizable FCNC couplings in the up sector. We calculate the branching ratio of $B_s \to μ^+ μ^-$ to lead…
▽ More
We present a Two-Higgs-Doublet Model in which the structure of the quark Yukawa matrices is governed by three spurions breaking the flavour symmetries of the quark Yukawa sector. The model naturally suppresses flavour-changing neutral current (FCNC) amplitudes in the down-type sector, but permits sizable FCNC couplings in the up sector. We calculate the branching ratio of $B_s \to μ^+ μ^-$ to leading and next-to-leading order of QCD for the case with FCNC couplings of the heavy neutral Higgs bosons to up-type quarks and verify that all counterterms follow the pattern dictated by the spurion expansion of the Yukawa matrices. We find correlations between $B_s \to μ^+ μ^-$, $b\to sγ$, and the Higgs masses. The $B_s - \bar B_s$ mixing amplitude is naturally suppressed in the model but can probe a portion of the parameter space with very heavy Higgs bosons.
△ Less
Submitted 12 April, 2024; v1 submitted 21 December, 2022;
originally announced December 2022.
-
The first cohomology of D(2,1;α) with coefficients in baby Verma modules
Authors:
Shuang Lang,
Wende Liu,
Shujuan Wang
Abstract:
Over a field of characteristic p > 3, the first cohomology group of Lie superalgebra D(2,1;α) with coefficients in baby Verma modules is determined by calculating the outer superderivations of D(2,1;α).
Over a field of characteristic p > 3, the first cohomology group of Lie superalgebra D(2,1;α) with coefficients in baby Verma modules is determined by calculating the outer superderivations of D(2,1;α).
△ Less
Submitted 14 June, 2022;
originally announced June 2022.
-
Static force characteristic of annular gaps -- Experimental and simulation results
Authors:
Maximilian M. G. Kuhr,
Sebastian R. Lang,
Peter F. Pelz
Abstract:
We discuss the static force characteristic of annular gaps resulting from an axial flow component. So far there is a severe lack of understanding of the flow inside the annulus. First, the state-of-the-art modelling approaches to describe the flow inside the annulus are recapped and discussed. The discussion focuses in particular on the modelling of inertia effects. Second, a new calculation metho…
▽ More
We discuss the static force characteristic of annular gaps resulting from an axial flow component. So far there is a severe lack of understanding of the flow inside the annulus. First, the state-of-the-art modelling approaches to describe the flow inside the annulus are recapped and discussed. The discussion focuses in particular on the modelling of inertia effects. Second, a new calculation method, the Clearance-Averaged Pressure Model (CAPM) is presented. The CAPM uses an integro-differential approach in combination with power law ansatz functions for the velocity profiles and a Hirs' model to calculate the resulting pressure field. Third, for experimental validation, a setup is presented using magnetic bearings to inherently measure the position as well as the force on the rotor induced by the flow field inside the gap. The experiments focus on the characteristic load behaviour, attitude angle and pressure difference across the annulus. Fourth, the experimental results are compared to the calculation results.
△ Less
Submitted 17 December, 2021; v1 submitted 12 November, 2021;
originally announced November 2021.
-
Nonergodicity parameters of confined hard-sphere glasses
Authors:
Suvendu Mandal,
Simon Lang,
Vitalie Boţan,
Thomas Franosch
Abstract:
Within a recently developed mode-coupling theory for fluids confined to a slit we elaborate numerical results for the long-time limits of suitably generalized intermediate scattering functions. The theory requires as input the density profile perpendicular to the plates, which we obtain from density functional theory within the fundamental-measure framework, as well as symmetry-adapted static stru…
▽ More
Within a recently developed mode-coupling theory for fluids confined to a slit we elaborate numerical results for the long-time limits of suitably generalized intermediate scattering functions. The theory requires as input the density profile perpendicular to the plates, which we obtain from density functional theory within the fundamental-measure framework, as well as symmetry-adapted static structure factors which can be calculated relying on the inhomogeneous Percus-Yevick closure. Our calculations for the nonergodicity parameters for both the collective as well as for the self motion are in qualitative agreement with our extensive event-driven molecular dynamics simulations for the intermediate scattering functions for slightly polydisperse hard-sphere systems at high packing fraction. We show that the variation of the nonergodicity parameters as a function of the wavenumber correlates with the in-plane static structure factors, while subtle effects become apparent in the structure factors and relaxation times of higher mode-indices. A criterion to predict the multiple reentrant from the variation of the in-plane static structure is presented.
△ Less
Submitted 27 October, 2021;
originally announced October 2021.
-
CLEVA-Compass: A Continual Learning EValuation Assessment Compass to Promote Research Transparency and Comparability
Authors:
Martin Mundt,
Steven Lang,
Quentin Delfosse,
Kristian Kersting
Abstract:
What is the state of the art in continual machine learning? Although a natural question for predominant static benchmarks, the notion to train systems in a lifelong manner entails a plethora of additional challenges with respect to set-up and evaluation. The latter have recently sparked a growing amount of critiques on prominent algorithm-centric perspectives and evaluation protocols being too nar…
▽ More
What is the state of the art in continual machine learning? Although a natural question for predominant static benchmarks, the notion to train systems in a lifelong manner entails a plethora of additional challenges with respect to set-up and evaluation. The latter have recently sparked a growing amount of critiques on prominent algorithm-centric perspectives and evaluation protocols being too narrow, resulting in several attempts at constructing guidelines in favor of specific desiderata or arguing against the validity of prevalent assumptions. In this work, we depart from this mindset and argue that the goal of a precise formulation of desiderata is an ill-posed one, as diverse applications may always warrant distinct scenarios. Instead, we introduce the Continual Learning EValuation Assessment Compass: the CLEVA-Compass. The compass provides the visual means to both identify how approaches are practically reported and how works can simultaneously be contextualized in the broader literature landscape. In addition to promoting compact specification in the spirit of recent replication trends, it thus provides an intuitive chart to understand the priorities of individual systems, where they resemble each other, and what elements are missing towards a fair comparison.
△ Less
Submitted 1 February, 2022; v1 submitted 7 October, 2021;
originally announced October 2021.
-
SNEWPY: A Data Pipeline from Supernova Simulations to Neutrino Signals
Authors:
Amanda L. Baxter,
Segev BenZvi,
Joahan Castaneda Jaimes,
Alexis Coleiro,
Marta Colomer Molla,
Damien Dornic,
Tomer Goldhagen,
Anne M. Graf,
Spencer Griswold,
Alec Habig,
Remington Hill,
Shunsaku Horiuchi James P. Kneller Rafael F. Lang,
Massimiliano Lincetto,
Jost Migenda,
Ko Nakamura,
Evan O'Connor,
Andrew Renshaw,
Kate Scholberg,
Navya Uberoi,
Arkin Worlikar
Abstract:
Current neutrino detectors will observe hundreds to thousands of neutrinos from a Galactic supernovae, and future detectors will increase this yield by an order of magnitude or more. With such a data set comes the potential for a huge increase in our understanding of the explosions of massive stars, nuclear physics under extreme conditions, and the properties of the neutrino. However, there is cur…
▽ More
Current neutrino detectors will observe hundreds to thousands of neutrinos from a Galactic supernovae, and future detectors will increase this yield by an order of magnitude or more. With such a data set comes the potential for a huge increase in our understanding of the explosions of massive stars, nuclear physics under extreme conditions, and the properties of the neutrino. However, there is currently a large gap between supernova simulations and the corresponding signals in neutrino detectors, which will make any comparison between theory and observation very difficult. SNEWPY is an open-source software package which bridges this gap. The SNEWPY code can interface with supernova simulation data to generate from the model either a time series of neutrino spectral fluences at Earth, or the total time-integrated spectral fluence. Data from several hundred simulations of core-collapse, thermonuclear, and pair-instability supernovae is included in the package. This output may then be used by an event generator such as sntools or an event rate calculator such as SNOwGLoBES. Additional routines in the SNEWPY package automate the processing of the generated data through the SNOwGLoBES software and collate its output into the observable channels of each detector. In this paper we describe the contents of the package, the physics behind SNEWPY, the organization of the code, and provide examples of how to make use of its capabilities.
△ Less
Submitted 16 September, 2021;
originally announced September 2021.
-
DAFNe: A One-Stage Anchor-Free Approach for Oriented Object Detection
Authors:
Steven Lang,
Fabrizio Ventola,
Kristian Kersting
Abstract:
We present DAFNe, a Dense one-stage Anchor-Free deep Network for oriented object detection. As a one-stage model, it performs bounding box predictions on a dense grid over the input image, being architecturally simpler in design, as well as easier to optimize than its two-stage counterparts. Furthermore, as an anchor-free model, it reduces the prediction complexity by refraining from employing bou…
▽ More
We present DAFNe, a Dense one-stage Anchor-Free deep Network for oriented object detection. As a one-stage model, it performs bounding box predictions on a dense grid over the input image, being architecturally simpler in design, as well as easier to optimize than its two-stage counterparts. Furthermore, as an anchor-free model, it reduces the prediction complexity by refraining from employing bounding box anchors. With DAFNe we introduce an orientation-aware generalization of the center-ness function for arbitrarily oriented bounding boxes to down-weight low-quality predictions and a center-to-corner bounding box prediction strategy that improves object localization performance. Our experiments show that DAFNe outperforms all previous one-stage anchor-free models on DOTA 1.0, DOTA 1.5, and UCAS-AOD and is on par with the best models on HRSC2016.
△ Less
Submitted 30 May, 2022; v1 submitted 13 September, 2021;
originally announced September 2021.
-
Ginzburg effect in a dielectric medium with dispersion and dissipation
Authors:
Sascha Lang,
Roland Sauerbrey,
Ralf Schützhold,
William G. Unruh
Abstract:
As a quantum analog of Cherenkov radiation, an inertial photon detector moving through a medium with constant refractive index $n$ may perceive the electromagnetic quantum fluctuations as real photons if its velocity $v$ exceeds the medium speed of light $c/n$. For dispersive Hopfield type media, we find this Ginzburg effect to extend to much lower $v$ because the phase velocity of light is very s…
▽ More
As a quantum analog of Cherenkov radiation, an inertial photon detector moving through a medium with constant refractive index $n$ may perceive the electromagnetic quantum fluctuations as real photons if its velocity $v$ exceeds the medium speed of light $c/n$. For dispersive Hopfield type media, we find this Ginzburg effect to extend to much lower $v$ because the phase velocity of light is very small near the medium resonance. In this regime, however, dissipation effects become important. Via an extended Hopfield model, we present a consistent treatment of quantum fluctuations in dispersive and dissipative media and derive the Ginzburg effect in such systems. Finally, we propose an experimental test.
△ Less
Submitted 19 May, 2022; v1 submitted 24 August, 2021;
originally announced August 2021.
-
Optical absorption and carrier multiplication at graphene edges in a magnetic field
Authors:
Friedemann Queisser,
Sascha Lang,
Ralf Schützhold
Abstract:
We study optical absorption at graphene edges in a transversal magnetic field. The magnetic field bends the trajectories of particle- and hole excitations into antipodal direction which generates a directed current. We find a rather strong amplification of the edge current by impact ionization processes. More concretely, the primary absorption and the subsequent carrier multiplication is analyzed…
▽ More
We study optical absorption at graphene edges in a transversal magnetic field. The magnetic field bends the trajectories of particle- and hole excitations into antipodal direction which generates a directed current. We find a rather strong amplification of the edge current by impact ionization processes. More concretely, the primary absorption and the subsequent carrier multiplication is analyzed for a graphene fold and a zigzag edge. We identify exact and approximate selection rules and discuss the dependence of the decay rates on the initial state.
△ Less
Submitted 30 July, 2021;
originally announced July 2021.
-
Object Retrieval and Localization in Large Art Collections using Deep Multi-Style Feature Fusion and Iterative Voting
Authors:
Nikolai Ufer,
Sabine Lang,
Björn Ommer
Abstract:
The search for specific objects or motifs is essential to art history as both assist in decoding the meaning of artworks. Digitization has produced large art collections, but manual methods prove to be insufficient to analyze them. In the following, we introduce an algorithm that allows users to search for image regions containing specific motifs or objects and find similar regions in an extensive…
▽ More
The search for specific objects or motifs is essential to art history as both assist in decoding the meaning of artworks. Digitization has produced large art collections, but manual methods prove to be insufficient to analyze them. In the following, we introduce an algorithm that allows users to search for image regions containing specific motifs or objects and find similar regions in an extensive dataset, helping art historians to analyze large digitized art collections. Computer vision has presented efficient methods for visual instance retrieval across photographs. However, applied to art collections, they reveal severe deficiencies because of diverse motifs and massive domain shifts induced by differences in techniques, materials, and styles. In this paper, we present a multi-style feature fusion approach that successfully reduces the domain gap and improves retrieval results without labelled data or curated image collections. Our region-based voting with GPU-accelerated approximate nearest-neighbour search allows us to find and localize even small motifs within an extensive dataset in a few seconds. We obtain state-of-the-art results on the Brueghel dataset and demonstrate its generalization to inhomogeneous collections with a large number of distractors.
△ Less
Submitted 14 July, 2021;
originally announced July 2021.
-
Einsum Networks: Fast and Scalable Learning of Tractable Probabilistic Circuits
Authors:
Robert Peharz,
Steven Lang,
Antonio Vergari,
Karl Stelzner,
Alejandro Molina,
Martin Trapp,
Guy Van den Broeck,
Kristian Kersting,
Zoubin Ghahramani
Abstract:
Probabilistic circuits (PCs) are a promising avenue for probabilistic modeling, as they permit a wide range of exact and efficient inference routines. Recent ``deep-learning-style'' implementations of PCs strive for a better scalability, but are still difficult to train on real-world data, due to their sparsely connected computational graphs. In this paper, we propose Einsum Networks (EiNets), a n…
▽ More
Probabilistic circuits (PCs) are a promising avenue for probabilistic modeling, as they permit a wide range of exact and efficient inference routines. Recent ``deep-learning-style'' implementations of PCs strive for a better scalability, but are still difficult to train on real-world data, due to their sparsely connected computational graphs. In this paper, we propose Einsum Networks (EiNets), a novel implementation design for PCs, improving prior art in several regards. At their core, EiNets combine a large number of arithmetic operations in a single monolithic einsum-operation, leading to speedups and memory savings of up to two orders of magnitude, in comparison to previous implementations. As an algorithmic contribution, we show that the implementation of Expectation-Maximization (EM) can be simplified for PCs, by leveraging automatic differentiation. Furthermore, we demonstrate that EiNets scale well to datasets which were previously out of reach, such as SVHN and CelebA, and that they can be used as faithful generative image models.
△ Less
Submitted 13 April, 2020;
originally announced April 2020.
-
A Content Transformation Block For Image Style Transfer
Authors:
Dmytro Kotovenko,
Artsiom Sanakoyeu,
Pingchuan Ma,
Sabine Lang,
Björn Ommer
Abstract:
Style transfer has recently received a lot of attention, since it allows to study fundamental challenges in image understanding and synthesis. Recent work has significantly improved the representation of color and texture and computational speed and image resolution. The explicit transformation of image content has, however, been mostly neglected: while artistic style affects formal characteristic…
▽ More
Style transfer has recently received a lot of attention, since it allows to study fundamental challenges in image understanding and synthesis. Recent work has significantly improved the representation of color and texture and computational speed and image resolution. The explicit transformation of image content has, however, been mostly neglected: while artistic style affects formal characteristics of an image, such as color, shape or texture, it also deforms, adds or removes content details. This paper explicitly focuses on a content-and style-aware stylization of a content image. Therefore, we introduce a content transformation module between the encoder and decoder. Moreover, we utilize similar content appearing in photographs and style samples to learn how style alters content details and we generalize this to other class details. Additionally, this work presents a novel normalization layer critical for high resolution image synthesis. The robustness and speed of our model enables a video stylization in real-time and high definition. We perform extensive qualitative and quantitative evaluations to demonstrate the validity of our approach.
△ Less
Submitted 18 March, 2020;
originally announced March 2020.
-
Quantum radiation in dielectric media with dispersion and dissipation
Authors:
Sascha Lang,
Ralf Schützhold,
William G. Unruh
Abstract:
By a generalization of the Hopfield model, we construct a microscopic Lagrangian describing a dielectric medium with dispersion and dissipation. This facilitates a well-defined and unambiguous $\textit{ab initio}$ treatment of quantum electrodynamics in such media, even in time-dependent backgrounds. As an example, we calculate the number of photons created by switching on and off dissipation in d…
▽ More
By a generalization of the Hopfield model, we construct a microscopic Lagrangian describing a dielectric medium with dispersion and dissipation. This facilitates a well-defined and unambiguous $\textit{ab initio}$ treatment of quantum electrodynamics in such media, even in time-dependent backgrounds. As an example, we calculate the number of photons created by switching on and off dissipation in dependence on the temporal switching function. This effect may be stronger than quantum radiation produced by variations of the refractive index $Δn(t)$ since the latter are typically very small and yield photon numbers of order $(Δn)^2$. As another difference, we find that the partner particles of the created medium photons are not other medium photons but excitations of the environment field causing the dissipation (which is switched on and off).
△ Less
Submitted 3 September, 2020; v1 submitted 20 December, 2019;
originally announced December 2019.
-
Virtual Ground Truth, and Pre-selection of 3D Interest Points for Improved Repeatability Evaluation of 2D Detectors
Authors:
Simon R Lang,
Martin H Luerssen,
David M Powers
Abstract:
In Computer Vision, finding simple features is performed using classifiers called interest point (IP) detectors, which are often utilised to track features as the scene changes. For 2D based classifiers it has been intuitive to measure repeated point reliability using 2D metrics given the difficulty to establish ground truth beyond 2D. The aim is to bridge the gap between 2D classifiers and 3D env…
▽ More
In Computer Vision, finding simple features is performed using classifiers called interest point (IP) detectors, which are often utilised to track features as the scene changes. For 2D based classifiers it has been intuitive to measure repeated point reliability using 2D metrics given the difficulty to establish ground truth beyond 2D. The aim is to bridge the gap between 2D classifiers and 3D environments, and improve performance analysis of 2D IP classification on 3D objects. This paper builds on existing work with 3D scanned and artificial models to test conventional 2D feature detectors with the assistance of virtualised 3D scenes. Virtual space depth is leveraged in tests to perform pre-selection of closest repeatable points in both 2D and 3D contexts before repeatability is measured. This more reliable ground truth is used to analyse testing configurations with a singular and 12 model dataset across affine transforms in x, y and z rotation, as well as x,y scaling with 9 well known IP detectors. The virtual scene's ground truth demonstrates that 3D pre-selection eliminates a large portion of false positives that are normally considered repeated in 2D configurations. The results indicate that 3D virtual environments can provide assistance in comparing the performance of conventional detectors when extending their applications to 3D environments, and can result in better classification of features when testing prospective classifiers' performance. A ROC based informedness measure also highlights tradeoffs in 2D/3D performance compared to conventional repeatability measures.
△ Less
Submitted 5 March, 2019;
originally announced March 2019.
-
Bayesian Effect Selection in Structured Additive Distributional Regression Models
Authors:
Nadja Klein,
Manuel Carlan,
Thomas Kneib,
Stefan Lang,
Helga Wagner
Abstract:
We propose a novel spike and slab prior specification with scaled beta prime marginals for the importance parameters of regression coefficients to allow for general effect selection within the class of structured additive distributional regression. This enables us to model effects on all distributional parameters for arbitrary parametric distributions, and to consider various effect types such as…
▽ More
We propose a novel spike and slab prior specification with scaled beta prime marginals for the importance parameters of regression coefficients to allow for general effect selection within the class of structured additive distributional regression. This enables us to model effects on all distributional parameters for arbitrary parametric distributions, and to consider various effect types such as non-linear or spatial effects as well as hierarchical regression structures. Our spike and slab prior relies on a parameter expansion that separates blocks of regression coefficients into overall scalar importance parameters and vectors of standardised coefficients. Hence, we can work with a scalar quantity for effect selection instead of a possibly high-dimensional effect vector, which yields improved shrinkage and sampling performance compared to the classical normal-inverse-gamma prior. We investigate the propriety of the posterior, show that the prior yields desirable shrinkage properties, propose a way of eliciting prior parameters and provide efficient Markov Chain Monte Carlo sampling. Using both simulated and three large-scale data sets, we show that our approach is applicable for data with a potentially large number of covariates, multilevel predictors accounting for hierarchically nested data and non-standard response distributions, such as bivariate normal or zero-inflated Poisson.
△ Less
Submitted 27 February, 2019;
originally announced February 2019.
-
Standard Model Physics at the HL-LHC and HE-LHC
Authors:
P. Azzi,
S. Farry,
P. Nason,
A. Tricoli,
D. Zeppenfeld,
R. Abdul Khalek,
J. Alimena,
N. Andari,
L. Aperio Bella,
A. J. Armbruster,
J. Baglio,
S. Bailey,
E. Bakos,
A. Bakshi,
C. Baldenegro,
F. Balli,
A. Barker,
W. Barter,
J. de Blas,
F. Blekman,
D. Bloch,
A. Bodek,
M. Boonekamp,
E. Boos,
J. D. Bossio Sola
, et al. (201 additional authors not shown)
Abstract:
The successful operation of the Large Hadron Collider (LHC) and the excellent performance of the ATLAS, CMS, LHCb and ALICE detectors in Run-1 and Run-2 with $pp$ collisions at center-of-mass energies of 7, 8 and 13 TeV as well as the giant leap in precision calculations and modeling of fundamental interactions at hadron colliders have allowed an extraordinary breadth of physics studies including…
▽ More
The successful operation of the Large Hadron Collider (LHC) and the excellent performance of the ATLAS, CMS, LHCb and ALICE detectors in Run-1 and Run-2 with $pp$ collisions at center-of-mass energies of 7, 8 and 13 TeV as well as the giant leap in precision calculations and modeling of fundamental interactions at hadron colliders have allowed an extraordinary breadth of physics studies including precision measurements of a variety physics processes. The LHC results have so far confirmed the validity of the Standard Model of particle physics up to unprecedented energy scales and with great precision in the sectors of strong and electroweak interactions as well as flavour physics, for instance in top quark physics. The upgrade of the LHC to a High Luminosity phase (HL-LHC) at 14 TeV center-of-mass energy with 3 ab$^{-1}$ of integrated luminosity will probe the Standard Model with even greater precision and will extend the sensitivity to possible anomalies in the Standard Model, thanks to a ten-fold larger data set, upgraded detectors and expected improvements in the theoretical understanding. This document summarises the physics reach of the HL-LHC in the realm of strong and electroweak interactions and top quark physics, and provides a glimpse of the potential of a possible further upgrade of the LHC to a 27 TeV $pp$ collider, the High-Energy LHC (HE-LHC), assumed to accumulate an integrated luminosity of 15 ab$^{-1}$.
△ Less
Submitted 20 December, 2019; v1 submitted 11 February, 2019;
originally announced February 2019.
-
Analog of cosmological particle creation in electromagnetic waveguides
Authors:
Sascha Lang,
Ralf Schützhold
Abstract:
We consider an electromagnetic waveguide with a time-dependent propagation speed $v(t)$ as an analog for cosmological particle creation. In contrast to most previous studies which focus on the number of particles produced, we calculate the corresponding two-point correlation function. For a small step-like variation $δv(t)$, this correlator displays characteristic signatures of particle pair creat…
▽ More
We consider an electromagnetic waveguide with a time-dependent propagation speed $v(t)$ as an analog for cosmological particle creation. In contrast to most previous studies which focus on the number of particles produced, we calculate the corresponding two-point correlation function. For a small step-like variation $δv(t)$, this correlator displays characteristic signatures of particle pair creation. As another potential advantage, this observable is of first order in the perturbation $δv(t)$, whereas the particle number is second order in $δv(t)$ and thus stronger suppressed for small $δv(t)$.
△ Less
Submitted 27 May, 2019; v1 submitted 22 August, 2018;
originally announced August 2018.
-
A Style-Aware Content Loss for Real-time HD Style Transfer
Authors:
Artsiom Sanakoyeu,
Dmytro Kotovenko,
Sabine Lang,
Björn Ommer
Abstract:
Recently, style transfer has received a lot of attention. While much of this research has aimed at speeding up processing, the approaches are still lacking from a principled, art historical standpoint: a style is more than just a single image or an artist, but previous work is limited to only a single instance of a style or shows no benefit from more images. Moreover, previous work has relied on a…
▽ More
Recently, style transfer has received a lot of attention. While much of this research has aimed at speeding up processing, the approaches are still lacking from a principled, art historical standpoint: a style is more than just a single image or an artist, but previous work is limited to only a single instance of a style or shows no benefit from more images. Moreover, previous work has relied on a direct comparison of art in the domain of RGB images or on CNNs pre-trained on ImageNet, which requires millions of labeled object bounding boxes and can introduce an extra bias, since it has been assembled without artistic consideration. To circumvent these issues, we propose a style-aware content loss, which is trained jointly with a deep encoder-decoder network for real-time, high-resolution stylization of images and videos. We propose a quantitative measure for evaluating the quality of a stylized image and also have art historians rank patches from our approach against those from previous work. These and our qualitative results ranging from small image patches to megapixel stylistic images and videos show that our approach better captures the subtle nature in which a style affects content.
△ Less
Submitted 28 July, 2018; v1 submitted 26 July, 2018;
originally announced July 2018.
-
Ewald sphere construction for structural colors
Authors:
Lukas Maiwald,
Slawa Lang,
Dirk Jalas,
Hagen Renner,
Alexander Yu. Petrov,
Manfred Eich
Abstract:
Disordered structures producing a non-iridescent color impression have been shown to feature a spherically shaped Fourier transform of their refractive-index distribution. We determine the direction and efficiency of scattering from thin films made from such structures with the help of the Ewald sphere construction which follows from first-order scattering approximation. This way we present a simp…
▽ More
Disordered structures producing a non-iridescent color impression have been shown to feature a spherically shaped Fourier transform of their refractive-index distribution. We determine the direction and efficiency of scattering from thin films made from such structures with the help of the Ewald sphere construction which follows from first-order scattering approximation. This way we present a simple geometrical argument why these structures are well suited for creating short wavelength colors like blue but are hindered from producing long wavelength colors like red. We also numerically synthesize a model structure dedicated to produce a sharp spherical shell in reciprocal space. The reflectivity of this structure as predicted by the first-order approximation is compared to direct electromagnetic simulations. The results indicate the Ewald sphere construction to constitute a simple geometrical tool that can be used to describe and to explain important spectral and directional features of the reflectivity. It is shown that total internal reflection in the film in combination with directed scattering can be used to obtain long wavelength structural colors.
△ Less
Submitted 5 March, 2018;
originally announced March 2018.
-
A quantitative first-order approach for the scattering of light by structured thin films
Authors:
Slawa Lang,
Lukas Maiwald,
Hagen Renner,
Dirk Jalas,
Alexander Yu. Petrov,
Manfred Eich
Abstract:
We present a full vectorial first-order approach to the scattering by arbitrary photonic structures with a low refractive index contrast. Our approach uses the first-order Born approximation and keeps the simple geometrical representation of the Ewald sphere construction. Via normalization to a representative sample volume, the approach can also predict the scattering by infinitely extended layers…
▽ More
We present a full vectorial first-order approach to the scattering by arbitrary photonic structures with a low refractive index contrast. Our approach uses the first-order Born approximation and keeps the simple geometrical representation of the Ewald sphere construction. Via normalization to a representative sample volume, the approach can also predict the scattering by infinitely extended layers of scattering media. It can therefore be used to describe and efficiently calculate the scattering by structures where the linear first-order scattering terms dominate, e.g. in low index contrast disordered structures creating a color impression.
△ Less
Submitted 20 February, 2018;
originally announced February 2018.
-
Bayesian Measurement Error Correction in Structured Additive Distributional Regression with an Application to the Analysis of Sensor Data on Soil-Plant Variability
Authors:
Alessio Pollice,
Giovanna Jona Lasinio,
Roberta Rossi,
Mariana Amato,
Thomas Kneib,
Stefan Lang
Abstract:
The flexibility of the Bayesian approach to account for covariates with measurement error is combined with semiparametric regression models for a class of continuous, discrete and mixed univariate response distributions with potentially all parameters depending on a structured additive predictor. Markov chain Monte Carlo enables a modular and numerically efficient implementation of Bayesian measur…
▽ More
The flexibility of the Bayesian approach to account for covariates with measurement error is combined with semiparametric regression models for a class of continuous, discrete and mixed univariate response distributions with potentially all parameters depending on a structured additive predictor. Markov chain Monte Carlo enables a modular and numerically efficient implementation of Bayesian measurement error correction based on the imputation of unobserved error-free covariate values. We allow for very general measurement errors, including correlated replicates with heterogeneous variances. The proposal is first assessed by a simulation trial, then it is applied to the assessment of a soil-plant relationship crucial for implementing efficient agricultural management practices. Observations on multi-depth soil information forage ground-cover for a seven hectares Alfalfa stand in South Italy were obtained using sensors with very refined spatial resolution. Estimating a functional relation between ground-cover and soil with these data involves addressing issues linked to the spatial and temporal misalignment and the large data size. We propose a preliminary spatial interpolation on a lattice covering the field and subsequent analysis by a structured additive distributional regression model accounting for measurement error in the soil covariate. Results are interpreted and commented in connection to possible Alfalfa management strategies.
△ Less
Submitted 29 November, 2017;
originally announced November 2017.
-
Projective cases for the restriction of the oscillator representation to dual pairs of type I
Authors:
Sabine J. Lang
Abstract:
For all the irreducible dual pairs of type I $(G,G')$, we analyze the restriction of the oscillator representation as a $(\mathfrak{g}', K')$-module, when $G'$ is the smaller group. For all $(G,G')$ in the stable range, as well as one more case, the modules obtained are projective. We use the duality correspondence introduced by Howe to analyze these restrictions.
For all the irreducible dual pairs of type I $(G,G')$, we analyze the restriction of the oscillator representation as a $(\mathfrak{g}', K')$-module, when $G'$ is the smaller group. For all $(G,G')$ in the stable range, as well as one more case, the modules obtained are projective. We use the duality correspondence introduced by Howe to analyze these restrictions.
△ Less
Submitted 5 December, 2019; v1 submitted 28 November, 2017;
originally announced November 2017.
-
Analysis of pion production data measured by HADES in proton-proton collisions at 1.25 GeV
Authors:
G. Agakishiev,
A. Balanda,
D. Belver,
A. Belyaev,
J. C. Berger-Chen,
A. Blanco,
M. Böhmer,
J. L. Boyard,
P. Cabanelas,
S. Chernenko,
A. Dybczak,
E. Epple,
L. Fabbietti,
O. Fateev,
P. Finocchiaro,
P. Fonte,
J. Friese,
I. Fröhlich,
T. Galatyuk,
J. A. Garzón,
R. Gernhäuser,
K. Göbel,
M. Golubeva,
D. González-Díaz,
F. Guber
, et al. (75 additional authors not shown)
Abstract:
Baryon resonance production in proton-proton collisions at a kinetic beam energy of 1.25 GeV is investigated. The multi-differential data were measured by the HADES collaboration. Exclusive channels with one pion in the final state ($npπ^{+}$ and $ppπ^{0}$) were put to extended studies based on various observables in the framework of a one-pion exchange model and with solutions obtained within the…
▽ More
Baryon resonance production in proton-proton collisions at a kinetic beam energy of 1.25 GeV is investigated. The multi-differential data were measured by the HADES collaboration. Exclusive channels with one pion in the final state ($npπ^{+}$ and $ppπ^{0}$) were put to extended studies based on various observables in the framework of a one-pion exchange model and with solutions obtained within the framework of a partial wave analysis (PWA) of the Bonn-Gatchina group. The results of the PWA confirm the dominant contribution of the $Δ$(1232), yet with a sizable impact of the $N$(1440) and non-resonant partial waves.
△ Less
Submitted 24 March, 2017;
originally announced March 2017.
-
Automated Linear-Time Detection and Quality Assessment of Superpixels in Uncalibrated True- or False-Color RGB Images
Authors:
Andrea Baraldi,
Dirk Tiede,
Stefan Lang
Abstract:
Capable of automated near real time superpixel detection and quality assessment in an uncalibrated monitor typical red green blue (RGB) image, depicted in either true or false colors, an original low level computer vision (CV) lightweight computer program, called RGB Image Automatic Mapper (RGBIAM), is designed and implemented. Constrained by the Calibration Validation (CalVal) requirements of the…
▽ More
Capable of automated near real time superpixel detection and quality assessment in an uncalibrated monitor typical red green blue (RGB) image, depicted in either true or false colors, an original low level computer vision (CV) lightweight computer program, called RGB Image Automatic Mapper (RGBIAM), is designed and implemented. Constrained by the Calibration Validation (CalVal) requirements of the Quality Assurance Framework for Earth Observation (QA4EO) guidelines, RGBIAM requires as mandatory an uncalibrated RGB image pre processing first stage, consisting of an automated statistical model based color constancy algorithm. The RGBIAM hybrid inference pipeline comprises: (I) a direct quantitative to nominal (QN) RGB variable transform, where RGB pixel values are mapped onto a prior dictionary of color names, equivalent to a static polyhedralization of the RGB cube. Prior color naming is the deductive counterpart of inductive vector quantization (VQ), whose typical VQ error function to minimize is a root mean square error (RMSE). In the output multi level color map domain, superpixels are automatically detected in linear time as connected sets of pixels featuring the same color label. (II) An inverse nominal to quantitative (NQ) RGB variable transform, where a superpixelwise constant RGB image approximation is generated in linear time to assess a VQ error image. The hybrid direct and inverse RGBIAM QNQ transform is: (i) general purpose, data and application independent. (ii) Automated, i.e., it requires no user machine interaction. (iii) Near real time, with a computational complexity increasing linearly with the image size. (iv) Implemented in tile streaming mode, to cope with massive images. Collected outcome and process quality indicators, including degree of automation, computational efficiency, VQ rate and VQ error, are consistent with theoretical expectations.
△ Less
Submitted 8 January, 2017;
originally announced January 2017.
-
Stage 4 validation of the Satellite Image Automatic Mapper lightweight computer program for Earth observation Level 2 product generation, Part 2 Validation
Authors:
Andrea Baraldi,
Michael Laurence Humber,
Dirk Tiede,
Stefan Lang
Abstract:
The European Space Agency (ESA) defines an Earth Observation (EO) Level 2 product as a multispectral (MS) image corrected for geometric, atmospheric, adjacency and topographic effects, stacked with its scene classification map (SCM) whose legend includes quality layers such as cloud and cloud-shadow. No ESA EO Level 2 product has ever been systematically generated at the ground segment. To contrib…
▽ More
The European Space Agency (ESA) defines an Earth Observation (EO) Level 2 product as a multispectral (MS) image corrected for geometric, atmospheric, adjacency and topographic effects, stacked with its scene classification map (SCM) whose legend includes quality layers such as cloud and cloud-shadow. No ESA EO Level 2 product has ever been systematically generated at the ground segment. To contribute toward filling an information gap from EO big sensory data to the ESA EO Level 2 product, a Stage 4 validation (Val) of an off the shelf Satellite Image Automatic Mapper (SIAM) lightweight computer program for prior knowledge based MS color naming was conducted by independent means. A time-series of annual Web Enabled Landsat Data (WELD) image composites of the conterminous U.S. (CONUS) was selected as input dataset. The annual SIAM WELD maps of the CONUS were validated in comparison with the U.S. National Land Cover Data (NLCD) 2006 map. These test and reference maps share the same spatial resolution and spatial extent, but their map legends are not the same and must be harmonized. For the sake of readability this paper is split into two. The previous Part 1 Theory provided the multidisciplinary background of a priori color naming. The present Part 2 Validation presents and discusses Stage 4 Val results collected from the test SIAM WELD map time series and the reference NLCD map by an original protocol for wall to wall thematic map quality assessment without sampling, where the test and reference map legends can differ in agreement with the Part 1. Conclusions are that the SIAM-WELD maps instantiate a Level 2 SCM product whose legend is the FAO Land Cover Classification System (LCCS) taxonomy at the Dichotomous Phase (DP) Level 1 vegetation/nonvegetation, Level 2 terrestrial/aquatic or superior LCCS level.
△ Less
Submitted 8 January, 2017;
originally announced January 2017.