-
A Revisit of Large-Scale Patterns in Middle Stratospheric Circulation Variations
Authors:
Ningning Tao,
Xiaosong Chen,
Fei Xie,
Yongwen Zhang,
Yan Xia,
Xuan Ma,
Han Huang,
Hongyu Wang
Abstract:
Variations in stratospheric atmospheric circulation significantly influence tropospheric weather and climate, and understanding these variations can guide stratospheric aircraft development and operations. Despite a century of progress, large-scale patterns in stratospheric circulation remain poorly understood due to the stratosphere's complex nature. To address this, we applied the eigen microsta…
▽ More
Variations in stratospheric atmospheric circulation significantly influence tropospheric weather and climate, and understanding these variations can guide stratospheric aircraft development and operations. Despite a century of progress, large-scale patterns in stratospheric circulation remain poorly understood due to the stratosphere's complex nature. To address this, we applied the eigen microstate approach (EMA) to analyze zonal wind from 70-10 hPa using ERA5 reanalysis data from 1980-2022. We focused on the three leading modes, corresponding to the quasi-biennial oscillation (QBO) and stratospheric circulation in the Arctic and Antarctic. After removing high-frequency components, we observed a significant 11-year cycle in the Antarctic stratospheric circulation mode, possibly linked to the solar cycle. In contrast, the Arctic mode showed a 5-6-year cycle without 11-year periodicity. This difference likely arises from the seasonal timing of polar vortex breakdowns: the Antarctic vortex persists into late spring and summer, making it more sensitive to solar radiation, while the Arctic vortex peaks in winter and early spring. The fourth mode showed features of a Southern Hemisphere dipole and was significantly correlated with the Antarctic mode, leading it by about two months. Finally, we developed a linear prediction model that demonstrated predictive skill for the Antarctic polar vortex.
△ Less
Submitted 25 March, 2025;
originally announced March 2025.
-
Bayesian Flow Is All You Need to Sample Out-of-Distribution Chemical Spaces
Authors:
Nianze Tao
Abstract:
Generating novel molecules with higher properties than the training space, namely the out-of-distribution generation, is important for ${de~novo}$ drug design. However, it is not easy for distribution learning-based models, for example diffusion models, to solve this challenge as these methods are designed to fit the distribution of training data as close as possible. In this paper, we show that B…
▽ More
Generating novel molecules with higher properties than the training space, namely the out-of-distribution generation, is important for ${de~novo}$ drug design. However, it is not easy for distribution learning-based models, for example diffusion models, to solve this challenge as these methods are designed to fit the distribution of training data as close as possible. In this paper, we show that Bayesian flow network is capable of effortlessly generating high quality out-of-distribution samples that meet several scenarios. We introduce a semi-autoregressive training/sampling method that helps to enhance the model performance and surpass the state-of-the-art models.
△ Less
Submitted 14 February, 2025; v1 submitted 15 December, 2024;
originally announced December 2024.
-
A Bayesian Flow Network Framework for Chemistry Tasks
Authors:
Nianze Tao,
Minori Abe
Abstract:
In this work, we introduce ChemBFN, a language model that handles chemistry tasks based on Bayesian flow networks working on discrete data. A new accuracy schedule is proposed to improve the sampling quality by significantly reducing the reconstruction loss. We show evidence that our method is appropriate for generating molecules with satisfied diversity even when a smaller number of sampling step…
▽ More
In this work, we introduce ChemBFN, a language model that handles chemistry tasks based on Bayesian flow networks working on discrete data. A new accuracy schedule is proposed to improve the sampling quality by significantly reducing the reconstruction loss. We show evidence that our method is appropriate for generating molecules with satisfied diversity even when a smaller number of sampling steps is used. A classifier-free guidance method is adapted for conditional generation. It is also worthwhile to point out that after generative training, our model can be fine-tuned on regression and classification tasks with the state-of-the-art performance, which opens the gate of building all-in-one models in a single module style. Our model has been open sourced at https://github.com/Augus1999/bayesian-flow-network-for-chemistry.
△ Less
Submitted 2 January, 2025; v1 submitted 28 July, 2024;
originally announced July 2024.
-
Comprehensive Molecular Representation from Equivariant Transformer
Authors:
Nianze Tao,
Hiromi Morimoto,
Stefano Leoni
Abstract:
The tradeoff between precision and performance in molecular simulations can nowadays be addressed by machine-learned force fields (MLFF), which combine \textit{ab initio} accuracy with force field numerical efficiency. Different from conventional force fields however, incorporating relevant electronic degrees of freedom into MLFFs becomes important. Here, we implement an equivariant transformer th…
▽ More
The tradeoff between precision and performance in molecular simulations can nowadays be addressed by machine-learned force fields (MLFF), which combine \textit{ab initio} accuracy with force field numerical efficiency. Different from conventional force fields however, incorporating relevant electronic degrees of freedom into MLFFs becomes important. Here, we implement an equivariant transformer that embeds molecular net charge and spin state without additional neural network parameters. The model trained on a singlet/triplet non-correlated \ce{CH2} dataset can identify different spin states and shows state-of-the-art extrapolation capability. Therein, self-attention sensibly captures non-local effects, which, as we show, can be finely tuned over the network hyper-parameters. We indeed found that Softmax activation functions utilised in the self-attention mechanism of graph networks outperformed ReLU-like functions in prediction accuracy. Increasing the attention temperature from $τ= \sqrt{d}$ to $\sqrt{2d}$ further improved the extrapolation capability, indicating a weighty role of nonlocality. Additionally, a weight initialisation method was purposed that sensibly accelerated the training process.
△ Less
Submitted 7 March, 2024; v1 submitted 21 August, 2023;
originally announced August 2023.
