-
ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling
Authors:
Xiao Wang,
Jong-Youl Choi,
Takuya Kurihaya,
Isaac Lyngaas,
Hong-Jun Yoon,
Ming Fan,
Nasik Muhammad Nafi,
Aristeidis Tsaris,
Ashwin M. Aji,
Maliha Hossain,
Mohamed Wahib,
Dali Wang,
Peter Thornton,
Prasanna Balaprakash,
Moetasim Ashfaq,
Dan Lu
Abstract:
Sparse observations and coarse-resolution climate models limit effective regional decision-making, underscoring the need for robust downscaling. However, existing AI methods struggle with generalization across variables and geographies and are constrained by the quadratic complexity of Vision Transformer (ViT) self-attention. We introduce ORBIT-2, a scalable foundation model for global, hyper-reso…
▽ More
Sparse observations and coarse-resolution climate models limit effective regional decision-making, underscoring the need for robust downscaling. However, existing AI methods struggle with generalization across variables and geographies and are constrained by the quadratic complexity of Vision Transformer (ViT) self-attention. We introduce ORBIT-2, a scalable foundation model for global, hyper-resolution climate downscaling. ORBIT-2 incorporates two key innovations: (1) Residual Slim ViT (Reslim), a lightweight architecture with residual learning and Bayesian regularization for efficient, robust prediction; and (2) TILES, a tile-wise sequence scaling algorithm that reduces self-attention complexity from quadratic to linear, enabling long-sequence processing and massive parallelism. ORBIT-2 scales to 10 billion parameters across 32,768 GPUs, achieving up to 1.8 ExaFLOPS sustained throughput and 92-98% strong scaling efficiency. It supports downscaling to 0.9 km global resolution and processes sequences up to 4.2 billion tokens. On 7 km resolution benchmarks, ORBIT-2 achieves high accuracy with R^2 scores in the range of 0.98 to 0.99 against observation data.
△ Less
Submitted 7 May, 2025;
originally announced May 2025.
-
First results from a search for axionlike dark matter using octupole-deformed nuclei in a crystal
Authors:
Mingyu Fan,
Bassam Nima,
Aleksandar Radak,
Gonzalo Alonso-Álvarez,
Amar Vutha
Abstract:
Most of the matter in the universe is in the form of dark matter. However, dark matter has never been observed to interact with normal matter in laboratory experiments. ALPs -- ultralight axionlike particles -- are a class of dark matter models that are consistent with astrophysical constraints, and produce measurable signatures in the form of oscillating violations of discrete symmetries in nucle…
▽ More
Most of the matter in the universe is in the form of dark matter. However, dark matter has never been observed to interact with normal matter in laboratory experiments. ALPs -- ultralight axionlike particles -- are a class of dark matter models that are consistent with astrophysical constraints, and produce measurable signatures in the form of oscillating violations of discrete symmetries in nuclei. We report the first results from a search for oscillating parity-odd time-reversal-odd nuclear moments of $^{153}$Eu ions in a crystal, which leads to an experimental constraint on the ALP-gluon coupling strength across a wide band of ALP masses.
△ Less
Submitted 3 October, 2024;
originally announced October 2024.
-
Identifying diffuse spatial structures in high-energy photon lists
Authors:
Minjie Fan,
Jue Wang,
Vinay L. Kashyap,
Thomas C. M. Lee,
David A. van Dyk,
Andreas Zezas
Abstract:
Data from high-energy observations are usually obtained as lists of photon events. A common analysis task for such data is to identify whether diffuse emission exists, and to estimate its surface brightness, even in the presence of point sources that may be superposed. We have developed a novel non-parametric event list segmentation algorithm to divide up the field of view into distinct emission c…
▽ More
Data from high-energy observations are usually obtained as lists of photon events. A common analysis task for such data is to identify whether diffuse emission exists, and to estimate its surface brightness, even in the presence of point sources that may be superposed. We have developed a novel non-parametric event list segmentation algorithm to divide up the field of view into distinct emission components. We use photon location data directly, without binning them into an image. We first construct a graph from the Voronoi tessellation of the observed photon locations and then grow segments using a new adaptation of seeded region growing, that we call Seeded Region Growing on Graph, after which the overall method is named SRGonG. Starting with a set of seed locations, this results in an over-segmented dataset, which SRGonG then coalesces using a greedy algorithm where adjacent segments are merged to minimize a model comparison statistic; we use the Bayesian Information Criterion. Using SRGonG we are able to identify point-like and diffuse extended sources in the data with equal facility. We validate SRGonG using simulations, demonstrating that it is capable of discerning irregularly shaped low surface-brightness emission structures as well as point-like sources with strengths comparable to that seen in typical X-ray data. We demonstrate SRGonG's use on the Chandra data of the Antennae galaxies, and show that it segments the complex structures appropriately.
△ Less
Submitted 4 November, 2022; v1 submitted 15 August, 2022;
originally announced August 2022.