Showing 1–50 of 260 results for author: Tian, M

Engineering frustrated Rydberg spin models by graphical Floquet modulation

Authors: Mingsheng Tian, Rhine Samajdar, Bryce Gadway

Abstract: Arrays of Rydberg atoms interacting via dipole-dipole interactions offer a powerful platform for probing quantum many-body physics. However, these intrinsic interactions also determine and constrain the models -- and parameter regimes thereof -- for quantum simulation. Here, we propose a systematic framework to engineer arbitrary desired long-range interactions in Rydberg-atom lattices, enabling t… ▽ More Arrays of Rydberg atoms interacting via dipole-dipole interactions offer a powerful platform for probing quantum many-body physics. However, these intrinsic interactions also determine and constrain the models -- and parameter regimes thereof -- for quantum simulation. Here, we propose a systematic framework to engineer arbitrary desired long-range interactions in Rydberg-atom lattices, enabling the realization of fully tunable $J_1$-$J_2$-$J_3$ Heisenberg models. Using site-resolved periodic modulation of Rydberg states, we develop an experimentally feasible protocol to precisely control the interaction ratios $J_2/J_1$ and $J_3/J_1$ in a kagome lattice. This control can increase the effective range of interactions and drive transitions between competing spin-ordered and spin liquid phases. To generalize this approach beyond the kagome lattice, we reformulate the design of modulation patterns through a graph-theoretic approach, demonstrating the universality of our method across all 11 planar Archimedean lattices. Our strategy overcomes the inherent constraints of power-law-decaying dipolar interactions, providing a versatile toolbox for exploring frustrated magnetism, emergent topological phases, and quantum correlations in systems with long-range interactions. △ Less

Submitted 2 May, 2025; originally announced May 2025.

Mixture of Group Experts for Learning Invariant Representations

Authors: Lei Kang, Jia Li, Mi Tian, Hua Huang

Abstract: Sparsely activated Mixture-of-Experts (MoE) models effectively increase the number of parameters while maintaining consistent computational costs per token. However, vanilla MoE models often suffer from limited diversity and specialization among experts, constraining their performance and scalability, especially as the number of experts increases. In this paper, we present a novel perspective on v… ▽ More Sparsely activated Mixture-of-Experts (MoE) models effectively increase the number of parameters while maintaining consistent computational costs per token. However, vanilla MoE models often suffer from limited diversity and specialization among experts, constraining their performance and scalability, especially as the number of experts increases. In this paper, we present a novel perspective on vanilla MoE with top-$k$ routing inspired by sparse representation. This allows us to bridge established theoretical insights from sparse representation into MoE models. Building on this foundation, we propose a group sparse regularization approach for the input of top-$k$ routing, termed Mixture of Group Experts (MoGE). MoGE indirectly regularizes experts by imposing structural constraints on the routing inputs, while preserving the original MoE architecture. Furthermore, we organize the routing input into a 2D topographic map, spatially grouping neighboring elements. This structure enables MoGE to capture representations invariant to minor transformations, thereby significantly enhancing expert diversity and specialization. Comprehensive evaluations across various Transformer models for image classification and language modeling tasks demonstrate that MoGE substantially outperforms its MoE counterpart, with minimal additional memory and computation overhead. Our approach provides a simple yet effective solution to scale the number of experts and reduce redundancy among them. The source code is included in the supplementary material and will be publicly released. △ Less

Submitted 12 April, 2025; originally announced April 2025.

TensorSymmetry: a package to get symmetry-adapted tensors disentangling spin-orbit coupling effect and establishing analytical relationship with magnetic order

Authors: Rui-Chun Xiao, Yuanjun Jin, Zhi-Fan Zhang, Zi-Hao Feng, Ding-Fu Shao, Mingliang Tian

Abstract: The symmetry-constrained response tensors on transport, optical, and electromagnetic effects are of central importance in condensed matter physics because they can guide experimental detections and verify theoretical calculations. These tensors encompass various forms, including polar, axial, i-type (time-reversal even), and c-type (time-reversal odd) matrixes. The commonly used magnetic groups, h… ▽ More The symmetry-constrained response tensors on transport, optical, and electromagnetic effects are of central importance in condensed matter physics because they can guide experimental detections and verify theoretical calculations. These tensors encompass various forms, including polar, axial, i-type (time-reversal even), and c-type (time-reversal odd) matrixes. The commonly used magnetic groups, however, fail to describe the phenomena without the spin-orbit coupling (SOC) effect and cannot build the analytical relationship between magnetic orders with response tensors in magnetic materials. Developing approaches on these two aspects is quite demanding for theory and experiment. In this paper, we use the magnetic group, spin group, and extrinsic parameter method comprehensively to investigate the symmetry-constrained response tensors, then implement the above method in a platform called "TensorSymmetry". With the package, we can get the response tensors disentangling the effect free of SOC and establish the analytical relationship with magnetic order, which provides useful guidance for theoretical and experimental investigation for magnetic materials. △ Less

Submitted 6 April, 2025; originally announced April 2025.

The Gradient of Mean Molecular Weight Across the Radius Valley

Authors: Kevin Heng, James E. Owen, Meng Tian

Abstract: Photo-evaporation shapes the observed radii of small exoplanets and constrains the underlying distributions of atmospheric and core masses. However, the diversity of atmospheric chemistries corresponding to these distributions remains unelucidated. We develop a first-principles carbon-hydrogen-oxygen-sulfur-silicon (CHOSSi) outgassing model that accounts for non-ideal gas behavior (via fugacities)… ▽ More Photo-evaporation shapes the observed radii of small exoplanets and constrains the underlying distributions of atmospheric and core masses. However, the diversity of atmospheric chemistries corresponding to these distributions remains unelucidated. We develop a first-principles carbon-hydrogen-oxygen-sulfur-silicon (CHOSSi) outgassing model that accounts for non-ideal gas behavior (via fugacities) at high pressures, as well as the tendency for water and hydrogen to dissolve in melt (via solubility laws). We use data-driven radius valley constraints to establish the relationship between the atmospheric surface pressures and melt temperatures of sub-Neptunes. Sub-Neptunes with less massive rocky cores retain less of their primordial hydrogen envelopes, which leads to less heat retention and diminished melt temperatures at the surfaces of these cores. Lower melt temperatures lead thermodynamically to the dominance of carbon-, oxygen-, sulfur- and silicon-bearing molecules over molecular hydrogen, which naturally produce a diversity of mean molecular weights. Our geochemical outgassing calculations robustly predict a gradient of mean molecular weight across the radius valley, where the strength of this gradient is primarily driven by the oxygen fugacity of the molten cores and not by the carbon enrichment (or "metallicity") of the atmosphere. Smaller sub-Neptunes are predicted to have less hydrogen-dominated atmospheres. The precise relationship between the observed and outgassed chemistries requires an understanding of how convection near the core interacts with large-scale atmospheric circulation (driven by stellar heating) near the photosphere, as well as the influence of photochemistry. △ Less

Submitted 3 April, 2025; originally announced April 2025.

Comments: 21 pages, 11 figures, 5 tables

The Devil is in the Distributions: Explicit Modeling of Scene Content is Key in Zero-Shot Video Captioning

Authors: Mingkai Tian, Guorong Li, Yuankai Qi, Amin Beheshti, Javen Qinfeng Shi, Anton van den Hengel, Qingming Huang

Abstract: Zero-shot video captioning requires that a model generate high-quality captions without human-annotated video-text pairs for training. State-of-the-art approaches to the problem leverage CLIP to extract visual-relevant textual prompts to guide language models in generating captions. These methods tend to focus on one key aspect of the scene and build a caption that ignores the rest of the visual i… ▽ More Zero-shot video captioning requires that a model generate high-quality captions without human-annotated video-text pairs for training. State-of-the-art approaches to the problem leverage CLIP to extract visual-relevant textual prompts to guide language models in generating captions. These methods tend to focus on one key aspect of the scene and build a caption that ignores the rest of the visual input. To address this issue, and generate more accurate and complete captions, we propose a novel progressive multi-granularity textual prompting strategy for zero-shot video captioning. Our approach constructs three distinct memory banks, encompassing noun phrases, scene graphs of noun phrases, and entire sentences. Moreover, we introduce a category-aware retrieval mechanism that models the distribution of natural language surrounding the specific topics in question. Extensive experiments demonstrate the effectiveness of our method with 5.7%, 16.2%, and 3.4% improvements in terms of the main metric CIDEr on MSR-VTT, MSVD, and VATEX benchmarks compared to existing state-of-the-art. △ Less

Submitted 30 March, 2025; originally announced March 2025.

Comments: 13 pages

Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving

Authors: Yue Li, Meng Tian, Zhenyu Lin, Jiangtong Zhu, Dechang Zhu, Haiqiang Liu, Zining Wang, Yueyi Zhang, Zhiwei Xiong, Xinhai Zhao

Abstract: Existing benchmarks for Vision-Language Model (VLM) on autonomous driving (AD) primarily assess interpretability through open-form visual question answering (QA) within coarse-grained tasks, which remain insufficient to assess capabilities in complex driving scenarios. To this end, we introduce $\textbf{VLADBench}$, a challenging and fine-grained dataset featuring close-form QAs that progress from… ▽ More Existing benchmarks for Vision-Language Model (VLM) on autonomous driving (AD) primarily assess interpretability through open-form visual question answering (QA) within coarse-grained tasks, which remain insufficient to assess capabilities in complex driving scenarios. To this end, we introduce $\textbf{VLADBench}$, a challenging and fine-grained dataset featuring close-form QAs that progress from static foundational knowledge and elements to advanced reasoning for dynamic on-road situations. The elaborate $\textbf{VLADBench}$ spans 5 key domains: Traffic Knowledge Understanding, General Element Recognition, Traffic Graph Generation, Target Attribute Comprehension, and Ego Decision-Making and Planning. These domains are further broken down into 11 secondary aspects and 29 tertiary tasks for a granular evaluation. A thorough assessment of general and domain-specific (DS) VLMs on this benchmark reveals both their strengths and critical limitations in AD contexts. To further exploit the cognitive and reasoning interactions among the 5 domains for AD understanding, we start from a small-scale VLM and train the DS models on individual domain datasets (collected from 1.4M DS QAs across public sources). The experimental results demonstrate that the proposed benchmark provides a crucial step toward a more comprehensive assessment of VLMs in AD, paving the way for the development of more cognitively sophisticated and reasoning-capable AD systems. △ Less

Submitted 27 March, 2025; originally announced March 2025.

Statistical Inference for High-dimensional Matrix-variate Factor Models with Missing Observations

Authors: Yongxia Zhang, Jinwen Liang, Liwen Xu, Keming Yu, Maozai Tian

Abstract: This paper develops an inferential theory for high-dimensional matrix-variate factor models with missing observations. We propose an easy-to-use all-purpose method that involves two straightforward steps. First, we perform principal component analysis on two re-weighted covariance matrices to obtain the row and column loadings. Second, we utilize these loadings along with the matrix-variate data t… ▽ More This paper develops an inferential theory for high-dimensional matrix-variate factor models with missing observations. We propose an easy-to-use all-purpose method that involves two straightforward steps. First, we perform principal component analysis on two re-weighted covariance matrices to obtain the row and column loadings. Second, we utilize these loadings along with the matrix-variate data to derive the factors. We develop an inferential theory that establishes the consistency and the rate of convergence under general conditions and missing patterns. The simulation results demonstrate the adequacy of the asymptotic results in approximating the properties of a finite sample. Finally, we illustrate the application of our method using a real numerical dataset. △ Less

Submitted 24 March, 2025; originally announced March 2025.

Automatic Generation of Safety-compliant Linear Temporal Logic via Large Language Model: A Self-supervised Framework

Authors: Junle Li, Meiqi Tian, Bingzhuo Zhong

Abstract: Converting high-level tasks described by natural language into formal specifications like Linear Temporal Logic (LTL) is a key step towards providing formal safety guarantees over cyber-physical systems (CPS). While the compliance of the formal specifications themselves against the safety restrictions imposed on CPS is crucial for ensuring safety, most existing works only focus on translation cons… ▽ More Converting high-level tasks described by natural language into formal specifications like Linear Temporal Logic (LTL) is a key step towards providing formal safety guarantees over cyber-physical systems (CPS). While the compliance of the formal specifications themselves against the safety restrictions imposed on CPS is crucial for ensuring safety, most existing works only focus on translation consistency between natural languages and formal specifications. In this paper, we introduce AutoSafeLTL, a self-supervised framework that utilizes large language models (LLMs) to automate the generation of LTL specifications complying with a set of safety restrictions while preserving their logical consistency and semantic accuracy. As a key insight, our framework integrates Language Inclusion check with an automated counterexample-guided modification mechanism to ensure the safety-compliance of the resulting LTL specifications. In particular, we develop 1) an LLM-as-an-Aligner, which performs atomic proposition matching between generated LTL specifications and safety restrictions to enforce semantic alignment; and 2) an LLM-as-a-Critic, which automates LTL specification refinement by interpreting counterexamples derived from Language Inclusion checks. Experimental results demonstrate that our architecture effectively guarantees safety-compliance for the generated LTL specifications, achieving a 0% violation rate against imposed safety restrictions. This shows the potential of our work in synergizing AI and formal verification techniques, enhancing safety-aware specification generation and automatic verification for both AI and critical CPS applications. △ Less

Submitted 24 April, 2025; v1 submitted 20 March, 2025; originally announced March 2025.

Pi-GPS: Enhancing Geometry Problem Solving by Unleashing the Power of Diagrammatic Information

Authors: Junbo Zhao, Ting Zhang, Jiayu Sun, Mi Tian, Hua Huang

Abstract: Geometry problem solving has garnered increasing attention due to its potential applications in intelligent education field. Inspired by the observation that text often introduces ambiguities that diagrams can clarify, this paper presents Pi-GPS, a novel framework that unleashes the power of diagrammatic information to resolve textual ambiguities, an aspect largely overlooked in prior research. Sp… ▽ More Geometry problem solving has garnered increasing attention due to its potential applications in intelligent education field. Inspired by the observation that text often introduces ambiguities that diagrams can clarify, this paper presents Pi-GPS, a novel framework that unleashes the power of diagrammatic information to resolve textual ambiguities, an aspect largely overlooked in prior research. Specifically, we design a micro module comprising a rectifier and verifier: the rectifier employs MLLMs to disambiguate text based on the diagrammatic context, while the verifier ensures the rectified output adherence to geometric rules, mitigating model hallucinations. Additionally, we explore the impact of LLMs in theorem predictor based on the disambiguated formal language. Empirical results demonstrate that Pi-GPS surpasses state-of-the-art models, achieving a nearly 10\% improvement on Geometry3K over prior neural-symbolic approaches. We hope this work highlights the significance of resolving textual ambiguity in multimodal mathematical reasoning, a crucial factor limiting performance. △ Less

Submitted 7 March, 2025; originally announced March 2025.

Adaptive-LIO: Enhancing Robustness and Precision through Environmental Adaptation in LiDAR Inertial Odometry

Authors: Chengwei Zhao, Kun Hu, Jie Xu, Lijun Zhao, Baiwen Han, Kaidi Wu, Maoshan Tian, Shenghai Yuan

Abstract: The emerging Internet of Things (IoT) applications, such as driverless cars, have a growing demand for high-precision positioning and navigation. Nowadays, LiDAR inertial odometry becomes increasingly prevalent in robotics and autonomous driving. However, many current SLAM systems lack sufficient adaptability to various scenarios. Challenges include decreased point cloud accuracy with longer frame… ▽ More The emerging Internet of Things (IoT) applications, such as driverless cars, have a growing demand for high-precision positioning and navigation. Nowadays, LiDAR inertial odometry becomes increasingly prevalent in robotics and autonomous driving. However, many current SLAM systems lack sufficient adaptability to various scenarios. Challenges include decreased point cloud accuracy with longer frame intervals under the constant velocity assumption, coupling of erroneous IMU information when IMU saturation occurs, and decreased localization accuracy due to the use of fixed-resolution maps during indoor-outdoor scene transitions. To address these issues, we propose a loosely coupled adaptive LiDAR-Inertial-Odometry named \textbf{Adaptive-LIO}, which incorporates adaptive segmentation to enhance mapping accuracy, adapts motion modality through IMU saturation and fault detection, and adjusts map resolution adaptively using multi-resolution voxel maps based on the distance from the LiDAR center. Our proposed method has been tested in various challenging scenarios, demonstrating the effectiveness of the improvements we introduce. The code is open-source on GitHub: \href{https://github.com/chengwei0427/adaptive_lio}{Adaptive-LIO}. △ Less

Submitted 6 March, 2025; originally announced March 2025.

Electrically Reconfigurable Intelligent Optoelectronics in 2-D van der Waals Materials

Authors: Yu Wang, Dehui Zhang, Yihao Song, Jea Jung Lee, Meng Tian, Souvik Biswas, Fengnian Xia, Qiushi Guo

Abstract: In optoelectronics, achieving electrical reconfigurability is crucial as it enables the encoding, decoding, manipulating, and processing of information carried by light. In recent years, two-dimensional van der Waals (2-D vdW) materials have emerged as promising platforms for realizing reconfigurable optoelectronic devices. Compared to materials with bulk crystalline lattice, 2-D vdW materials off… ▽ More In optoelectronics, achieving electrical reconfigurability is crucial as it enables the encoding, decoding, manipulating, and processing of information carried by light. In recent years, two-dimensional van der Waals (2-D vdW) materials have emerged as promising platforms for realizing reconfigurable optoelectronic devices. Compared to materials with bulk crystalline lattice, 2-D vdW materials offer superior electrical reconfigurability due to high surface-to-volume ratio, quantum confinement, reduced dielectric screening effect, and strong dipole resonances. Additionally, their unique band structures and associated topology and quantum geometry provide novel tuning capabilities. This review article seeks to establish a connection between the fundamental physics underlying reconfigurable optoelectronics in 2-D materials and their burgeoning applications in intelligent optoelectronics. We first survey various electrically reconfigurable properties of 2-D vdW materials and the underlying tuning mechanisms. Then we highlight the emerging applications of such devices, including dynamic intensity, phase and polarization control, and intelligent sensing. Finally, we discuss the opportunities for future advancements in this field. △ Less

Submitted 28 February, 2025; originally announced March 2025.

EAIRA: Establishing a Methodology for Evaluating AI Models as Scientific Research Assistants

Authors: Franck Cappello, Sandeep Madireddy, Robert Underwood, Neil Getty, Nicholas Lee-Ping Chia, Nesar Ramachandra, Josh Nguyen, Murat Keceli, Tanwi Mallick, Zilinghan Li, Marieme Ngom, Chenhui Zhang, Angel Yanguas-Gil, Evan Antoniuk, Bhavya Kailkhura, Minyang Tian, Yufeng Du, Yuan-Sen Ting, Azton Wells, Bogdan Nicolae, Avinash Maurya, M. Mustafa Rafique, Eliu Huerta, Bo Li, Ian Foster , et al. (1 additional authors not shown)

Abstract: Recent advancements have positioned AI, and particularly Large Language Models (LLMs), as transformative tools for scientific research, capable of addressing complex tasks that require reasoning, problem-solving, and decision-making. Their exceptional capabilities suggest their potential as scientific research assistants but also highlight the need for holistic, rigorous, and domain-specific evalu… ▽ More Recent advancements have positioned AI, and particularly Large Language Models (LLMs), as transformative tools for scientific research, capable of addressing complex tasks that require reasoning, problem-solving, and decision-making. Their exceptional capabilities suggest their potential as scientific research assistants but also highlight the need for holistic, rigorous, and domain-specific evaluation to assess effectiveness in real-world scientific applications. This paper describes a multifaceted methodology for Evaluating AI models as scientific Research Assistants (EAIRA) developed at Argonne National Laboratory. This methodology incorporates four primary classes of evaluations. 1) Multiple Choice Questions to assess factual recall; 2) Open Response to evaluate advanced reasoning and problem-solving skills; 3) Lab-Style Experiments involving detailed analysis of capabilities as research assistants in controlled environments; and 4) Field-Style Experiments to capture researcher-LLM interactions at scale in a wide range of scientific domains and applications. These complementary methods enable a comprehensive analysis of LLM strengths and weaknesses with respect to their scientific knowledge, reasoning abilities, and adaptability. Recognizing the rapid pace of LLM advancements, we designed the methodology to evolve and adapt so as to ensure its continued relevance and applicability. This paper describes the methodology state at the end of February 2025. Although developed within a subset of scientific domains, the methodology is designed to be generalizable to a wide range of scientific domains. △ Less

Submitted 27 February, 2025; originally announced February 2025.

Comments: 33 pages, 18 figures

High-Pressure Tuning of Electrical Transport in Freestanding Oxide Films

Authors: Jingxin Chen, Xiang Huang, Zhihan Qiao, Jiao Li, Jiahao Xu, Haiyang Zhang, Deyang Li, Enyang Men, Hangtian Wang, Han Zhang, Jianyu Xie, Guolin Zheng, Mingliang Tian, Qun Niu, Lin Hao

Abstract: Electrical transport of oxide films under high pressure is largely unexplored due to the absence of a universal strategy. In this work, we have developed an in-house route to investigate the electrical transport properties of oxide films under high pressures, by improving the elasticity of freestanding oxide films and the robustness of high-pressure techniques on nano-devices. As a showcase, we in… ▽ More Electrical transport of oxide films under high pressure is largely unexplored due to the absence of a universal strategy. In this work, we have developed an in-house route to investigate the electrical transport properties of oxide films under high pressures, by improving the elasticity of freestanding oxide films and the robustness of high-pressure techniques on nano-devices. As a showcase, we investigated the electrical resistivity of perovskite SrIrO3 films under high pressures, and found a pressure-driven semimetal-to-insulator transition and an insulator-to-metal transition. At the monolayer-limit, the SrIrO3 films directly transform from an insulating state to a metallic state, highlighting the intriguing interplay of dimensionality and hydrostatic pressure in correlated oxides, which can be unveiled through the universal high-pressure strategy. △ Less

Submitted 26 February, 2025; originally announced February 2025.

iTRI-QA: a Toolset for Customized Question-Answer Dataset Generation Using Language Models for Enhanced Scientific Research

Authors: Qiming Liu, Zhongzheng Niu, Siting Liu, Mao Tian

Abstract: The exponential growth of AI in science necessitates efficient and scalable solutions for retrieving and preserving research information. Here, we present a tool for the development of a customized question-answer (QA) dataset, called Interactive Trained Research Innovator (iTRI) - QA, tailored for the needs of researchers leveraging language models (LMs) to retrieve scientific knowledge in a QA f… ▽ More The exponential growth of AI in science necessitates efficient and scalable solutions for retrieving and preserving research information. Here, we present a tool for the development of a customized question-answer (QA) dataset, called Interactive Trained Research Innovator (iTRI) - QA, tailored for the needs of researchers leveraging language models (LMs) to retrieve scientific knowledge in a QA format. Our approach integrates curated QA datasets with a specialized research paper dataset to enhance responses' contextual relevance and accuracy using fine-tuned LM. The framework comprises four key steps: (1) the generation of high-quality and human-generated QA examples, (2) the creation of a structured research paper database, (3) the fine-tuning of LMs using domain-specific QA examples, and (4) the generation of QA dataset that align with user queries and the curated database. This pipeline provides a dynamic and domain-specific QA system that augments the utility of LMs in academic research that will be applied for future research LM deployment. We demonstrate the feasibility and scalability of our tool for streamlining knowledge retrieval in scientific contexts, paving the way for its integration into broader multi-disciplinary applications. △ Less

Submitted 27 January, 2025; originally announced February 2025.

Comments: 13 pages, 3 figures

Stable Neel-Twisted Skyrmion Bags in a van der Waals Magnet Fe3-xGaTe2 at Room Temperature

Authors: Jialiang Jiang, Yaodong Wu, Lingyao Kong, Yongsen Zhang, Sheng Qiu, Huanhuan Zhang, Yajiao Ke, Shouguo Wang, Mingliang Tian, Jin Tang

Abstract: Magnetic skyrmion bags with diverse topological charges Q, offer prospects for future spintronic devices based on freedom of Q. While their emergence in van der Waals magnets holds the potential in developing Q-based 2D topological spintronics. However, previous room-temperature skyrmion bags necessitate special anisotropy engineering through disorder Fe intercalation, and the stable phase diagram… ▽ More Magnetic skyrmion bags with diverse topological charges Q, offer prospects for future spintronic devices based on freedom of Q. While their emergence in van der Waals magnets holds the potential in developing Q-based 2D topological spintronics. However, previous room-temperature skyrmion bags necessitate special anisotropy engineering through disorder Fe intercalation, and the stable phase diagram for skyrmion bags across room temperature regions is lacking. Here, we demonstrate the observation and electrical manipulation of room temperature skyrmion bags in Fe3-xGaTe2 without specially designed Fe intercalation. Combining the pulsed currents with the assistance of magnetic fields, skyrmion bags with various topological charges are generated and annihilated. Especially double nested skyrmion bags are also discovered at room temperature. The stable temperature-field diagram of skyrmion bags has been established. We also demonstrate the electrical-controlled topological phase transformations of skyrmion bags. Our results will provide novel insights for the design of 2D skyrmion-based high-performance devices. △ Less

Submitted 20 February, 2025; originally announced February 2025.

Comments: Published in Nano Letters DOI: 10.1021/acs.nanolett.4c06281

Isotropic superconductivity in pressurized trilayer nickelate La4Ni3O10

Authors: Di Peng, Yaolong Bian, Zhenfang Xing, Lixing Chen, Jiaqiang Cai, Tao Luo, Fujun Lan, Yuxin Liu, Yinghao Zhu, Enkang Zhang, Zhaosheng Wang, Yuping Sun, Yuzhu Wang, Xingya Wang, Chenyue Wang, Yuqi Yang, Yanping Yang, Hongliang Dong, Hongbo Lou, Zhidan Zeng, Zhi Zeng, Mingliang Tian, Jun Zhao, Qiaoshi Zeng, Jinglei Zhang , et al. (1 additional authors not shown)

Abstract: Evidence of superconductivity (SC) has recently been reported in pressurized La3Ni2O7 and La4Ni3O10, providing a new platform to explore high-temperature superconductivity. However, while zero resistance state has been observed, experimental characterization of the superconducting properties of pressurized nickelates is still limited and experimentally challenging. Here, we present the first full… ▽ More Evidence of superconductivity (SC) has recently been reported in pressurized La3Ni2O7 and La4Ni3O10, providing a new platform to explore high-temperature superconductivity. However, while zero resistance state has been observed, experimental characterization of the superconducting properties of pressurized nickelates is still limited and experimentally challenging. Here, we present the first full temperature dependence of the upper critical field Hc2 measurement in La4Ni3O10 single crystal, achieved by combining high magnetic field and high-pressure techniques. Remarkably, the Hc2 of La4Ni3O10 is nearly isotropic, with the anisotropic parameter monotonically increasing from 1.4 near Tc to 1 at lower temperatures. By analyzing the Hc2 using the two-band model, we uncover that the anisotropic diffusivity of the bands, primarily originating from d(z2 ) and d(x2-y2 ) orbitals, is well compensated, resulting in an unusually isotropic superconducting state. These findings provide critical experimental evidence that underscores the significant role of the d(z2 ) orbital in enabling superconductivity in pressurized Ruddlesden-Popper nickelates. △ Less

Submitted 20 February, 2025; originally announced February 2025.

Comments: 20 pages, 9 figures

Giant Uncompensated Magnon Spin Currents in X-type Magnets

Authors: Zi-An Wang, Bo Li, Shui-Sen Zhang, Wen-Jian Lu, Mingliang Tian, Yu-Ping Sun, Evgeny Y. Tsymbal, Kaiyou Wang, Haifeng Du, Ding-Fu Shao

Abstract: Magnon spin currents in insulating magnets are useful for low-power spintronics. However, in magnets stacked by antiferromagnetic (AFM) exchange coupling, which have recently aroused significant interest for potential applications in spintronics, these currents are largely counteracted by opposite magnetic sublattices, thus suppressing their net effect. Contrary to this common observation, here, w… ▽ More Magnon spin currents in insulating magnets are useful for low-power spintronics. However, in magnets stacked by antiferromagnetic (AFM) exchange coupling, which have recently aroused significant interest for potential applications in spintronics, these currents are largely counteracted by opposite magnetic sublattices, thus suppressing their net effect. Contrary to this common observation, here, we show that magnets with X-type AFM stacking, where opposite magnetic sublattices form orthogonal intersecting chains, support giant magnon spin currents with minimal compensation. Our model Hamiltonian calculations predict magnetic chain locking of magnon spin currents in these X-type magnets, significantly reducing their compensation ratio. In addition, the one-dimensional nature of the chain-like magnetic sublattices enhances magnon spin conductivities surpassing those of two-dimensional ferromagnets and canonical altermagnets. Notably, uncompensated X-type magnets, such as odd-layer antiferromagnets and ferrimagnets, can exhibit magnon spin currents polarized opposite to those expected by their net magnetization. These unprecedented properties of X-type magnets, combined with their inherent advantages resulting from AFM coupling, offer a promising new path for low-power high-performance spintronics. △ Less

Submitted 19 February, 2025; originally announced February 2025.

Exceptional-Point-Induced Nonequilibrium Entanglement Dynamics in Bosonic Networks

Authors: Chenghe Yu, Mingsheng Tian, Ningxin Kong, Matteo Fadel, Xinyao Huang, Qiongyi He

Abstract: Exceptional points (EPs), arising in non-Hermitian systems, have garnered significant attention in recent years, enabling advancements in sensing, wave manipulation, and mode selectivity. However, their role in quantum systems, particularly in influencing quantum correlations, remains underexplored. In this work, we investigate how EPs control multimode entanglement in bosonic chains. Using a Bogo… ▽ More Exceptional points (EPs), arising in non-Hermitian systems, have garnered significant attention in recent years, enabling advancements in sensing, wave manipulation, and mode selectivity. However, their role in quantum systems, particularly in influencing quantum correlations, remains underexplored. In this work, we investigate how EPs control multimode entanglement in bosonic chains. Using a Bogoliubov-de Gennes (BdG) framework to describe the Heisenberg equations, we identify EPs of varying orders and uncover spectral transitions between purely real, purely imaginary, and mixed eigenvalue spectra. These spectral regions, divided by EPs, correspond to three distinct entanglement dynamics: oscillatory, exponential, and hybrid. Remarkably, we demonstrate that higher-order EPs, realized by non-integer-pi hopping phases or nonuniform interaction strengths, significantly enhance the degree of multimode entanglement compared to second-order EPs. Our findings provide a pathway to leveraging EPs for entanglement control and exhibit the potential of non-Hermitian physics in advancing quantum technologies. △ Less

Submitted 6 February, 2025; originally announced February 2025.

Comments: 7 pages, 4 figures

Advancing Mathematical Reasoning in Language Models: The Impact of Problem-Solving Data, Data Synthesis Methods, and Training Stages

Authors: Zui Chen, Tianqiao Liu, Mi Tian, Qing Tong, Weiqi Luo, Zitao Liu

Abstract: Mathematical reasoning remains a challenging area for large language models (LLMs), prompting the development of math-specific LLMs such as LLEMMA, DeepSeekMath, and Qwen2-Math, among others. These models typically follow a two-stage training paradigm: pre-training with math-related corpora and post-training with problem datasets for supervised fine-tuning (SFT). Despite these efforts, the improve… ▽ More Mathematical reasoning remains a challenging area for large language models (LLMs), prompting the development of math-specific LLMs such as LLEMMA, DeepSeekMath, and Qwen2-Math, among others. These models typically follow a two-stage training paradigm: pre-training with math-related corpora and post-training with problem datasets for supervised fine-tuning (SFT). Despite these efforts, the improvements in mathematical reasoning achieved through continued pre-training (CPT) are often less significant compared to those obtained via SFT. This study addresses this discrepancy by exploring alternative strategies during the pre-training phase, focusing on the use of problem-solving data over general mathematical corpora. We investigate three primary research questions: (1) Can problem-solving data enhance the model's mathematical reasoning capabilities more effectively than general mathematical corpora during CPT? (2) Are synthetic data from the same source equally effective, and which synthesis methods are most efficient? (3) How do the capabilities developed from the same problem-solving data differ between the CPT and SFT stages, and what factors contribute to these differences? Our findings indicate that problem-solving data significantly enhances the model's mathematical capabilities compared to general mathematical corpora. We also identify effective data synthesis methods, demonstrating that the tutorship amplification synthesis method achieves the best performance. Furthermore, while SFT facilitates instruction-following abilities, it underperforms compared to CPT with the same data, which can be partially attributed to its poor learning capacity for more challenging problem-solving data. These insights provide valuable guidance for optimizing the mathematical reasoning capabilities of LLMs, culminating in our development of a powerful mathematical base model called MathGPT-8B. △ Less

Submitted 23 March, 2025; v1 submitted 23 January, 2025; originally announced January 2025.

Comments: ICLR 2025

A Polarimetry-based Field-deployable Non-interruptive Mirror Soiling Detection Method

Authors: Mo Tian, Md Zubair Ebne Rafique, Kolappan Chidambaranathan, Randy Brost, Daniel Small, David Novick, Julius Yellowhair, Yu Yao

Abstract: The soiling level of heliostat mirrors in Concentrated Solar Power (CSP) fields is one of the key factors that significantly influences optical efficiency. State-of-the-art methods of monitoring heliostats soiling levels have limitations such as slow, labor-intensive, high-cost installation, and interruptive to solar field operations. Here we present a rapid, cost-effective, user-friendly and non-… ▽ More The soiling level of heliostat mirrors in Concentrated Solar Power (CSP) fields is one of the key factors that significantly influences optical efficiency. State-of-the-art methods of monitoring heliostats soiling levels have limitations such as slow, labor-intensive, high-cost installation, and interruptive to solar field operations. Here we present a rapid, cost-effective, user-friendly and non-intrusive Polarimetric Imaging-based Mirror Soiling (PIMS) detection method. The PIMS imaging device is very compact and can be integrated on an unmanned aerial vehicle (UAV) for single-shot measurement of large area measurement on Heliostat mirrors for fast soiling detection without labor-intensive inspection of each heliostat with a reflectometer. With skylight as a natural light source, we developed a methodology to correlate Degree of Linear Polarization (DoLP) image of mirrors to their soiling levels using an experimentally calibrated model based on Mie Scattering Theory and Monte-Carlo simulation. For field deployment of the PIMS method, minimal pre-installation is required, and the field operation is not interrupted by the UAV imaging process. The PIMS method has significant potential for deployment in various concentration solar-thermal power (CSP) plants, offering high speed, non-interruptive mirror soiling detection. Moreover, the method can be further developed for other types of solar fields, such as parabolic troughs, solar panels, etc. △ Less

Submitted 3 January, 2025; originally announced January 2025.

Comments: 38 pages, 9 figures

What Are Step-Level Reward Models Rewarding? Counterintuitive Findings from MCTS-Boosted Mathematical Reasoning

Authors: Yiran Ma, Zui Chen, Tianqiao Liu, Mi Tian, Zhuo Liu, Zitao Liu, Weiqi Luo

Abstract: Step-level reward models (SRMs) can significantly enhance mathematical reasoning performance through process supervision or step-level preference alignment based on reinforcement learning. The performance of SRMs is pivotal, as they serve as critical guidelines, ensuring that each step in the reasoning process is aligned with desired outcomes. Recently, AlphaZero-like methods, where Monte Carlo Tr… ▽ More Step-level reward models (SRMs) can significantly enhance mathematical reasoning performance through process supervision or step-level preference alignment based on reinforcement learning. The performance of SRMs is pivotal, as they serve as critical guidelines, ensuring that each step in the reasoning process is aligned with desired outcomes. Recently, AlphaZero-like methods, where Monte Carlo Tree Search (MCTS) is employed for automatic step-level preference annotation, have proven particularly effective. However, the precise mechanisms behind the success of SRMs remain largely unexplored. To address this gap, this study delves into the counterintuitive aspects of SRMs, particularly focusing on MCTS-based approaches. Our findings reveal that the removal of natural language descriptions of thought processes has minimal impact on the efficacy of SRMs. Furthermore, we demonstrate that SRMs are adept at assessing the complex logical coherence present in mathematical language while having difficulty in natural language. These insights provide a nuanced understanding of the core elements that drive effective step-level reward modeling in mathematical reasoning. By shedding light on these mechanisms, this study offers valuable guidance for developing more efficient and streamlined SRMs, which can be achieved by focusing on the crucial parts of mathematical reasoning. △ Less

Submitted 8 March, 2025; v1 submitted 20 December, 2024; originally announced December 2024.

Comments: AAAI 2025

RAC3: Retrieval-Augmented Corner Case Comprehension for Autonomous Driving with Vision-Language Models

Authors: Yujin Wang, Quanfeng Liu, Jiaqi Fan, Jinlong Hong, Hongqing Chu, Mengjian Tian, Bingzhao Gao, Hong Chen

Abstract: Understanding and addressing corner cases is essential for ensuring the safety and reliability of autonomous driving systems. Vision-language models (VLMs) play a crucial role in enhancing scenario comprehension, yet they face significant challenges, such as hallucination and insufficient real-world grounding, which compromise their performance in critical driving scenarios. In this work, RAC3, a… ▽ More Understanding and addressing corner cases is essential for ensuring the safety and reliability of autonomous driving systems. Vision-language models (VLMs) play a crucial role in enhancing scenario comprehension, yet they face significant challenges, such as hallucination and insufficient real-world grounding, which compromise their performance in critical driving scenarios. In this work, RAC3, a novel framework designed to enhance the performance of VLMs in corner case comprehension, is proposed. RAC3 integrates a frequency-spatial fusion (FSF) image encoder, cross-modal alignment fine-tuning with hard and semi-hard negative mining, and a fast querying pipeline based on KMeans clustering and hierarchical navigable small world (HNSW) indexing. A multimodal chain-of-thought (CoT) prompting strategy to guide analogical reasoning and reduce hallucinations during inference is introduced. Moreover, an update mechanism is integrated into RAC3 to ensure continual learning within the framework. Extensive experiments on the CODA and NuScenes datasets demonstrate that RAC3 significantly improves corner case comprehension across multiple downstream tasks. Compared to prior state-of-the-art methods, RAC3 achieves the highest final score of 74.46 on the CODA-LM benchmark and shows consistent performance gains when integrated with end-to-end frameworks like DriveLM. These results demonstrate the effectiveness of retrieval-augmented strategies and cross-modal alignment for safer and more interpretable autonomous driving. △ Less

Submitted 13 April, 2025; v1 submitted 14 December, 2024; originally announced December 2024.

Comments: 14 pages, 7 figures

Ultra low-cost fabrication of homogeneous alginate hydrogel microspheres in symmetry designed microfluidic device

Authors: Qing Qin, Yu Zhang, Yubei Wei, Jinnuo, Lv, Meiling Tian, Yuanyuan Sun, Xingjian, Huang, Jianglin Li, Yifeng, Su, Xiaoliang Xiang, Xing Hu, Zhizhi Zhou

Abstract: In this study, we present a two-stage method for fabricating monodisperse alginate hydrogel microspheres using a symmetrically designed flow-focusing microfluidic device. One of the flow-focusing junctions generates alginate hydrogel droplets without the addition of surfactants, while the other junction introduces corn oil with acetic acid, which facilitates the solidification of the homogeneous a… ▽ More In this study, we present a two-stage method for fabricating monodisperse alginate hydrogel microspheres using a symmetrically designed flow-focusing microfluidic device. One of the flow-focusing junctions generates alginate hydrogel droplets without the addition of surfactants, while the other junction introduces corn oil with acetic acid, which facilitates the solidification of the homogeneous alginate hydrogel droplets and prevents coalescence. These hydrogel microspheres can be easily separated from the oil phase using an oscillation state, eliminating the need for a demulsifier. This microfluidic system for hydrogel microsphere formation is notable for its simplicity, ease of fabrication, and user-friendliness. △ Less

Submitted 3 December, 2024; originally announced December 2024.

OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs

Authors: Akari Asai, Jacqueline He, Rulin Shao, Weijia Shi, Amanpreet Singh, Joseph Chee Chang, Kyle Lo, Luca Soldaini, Sergey Feldman, Mike D'arcy, David Wadden, Matt Latzke, Minyang Tian, Pan Ji, Shengyan Liu, Hao Tong, Bohao Wu, Yanyu Xiong, Luke Zettlemoyer, Graham Neubig, Dan Weld, Doug Downey, Wen-tau Yih, Pang Wei Koh, Hannaneh Hajishirzi

Abstract: Scientific progress depends on researchers' ability to synthesize the growing body of literature. Can large language models (LMs) assist scientists in this task? We introduce OpenScholar, a specialized retrieval-augmented LM that answers scientific queries by identifying relevant passages from 45 million open-access papers and synthesizing citation-backed responses. To evaluate OpenScholar, we dev… ▽ More Scientific progress depends on researchers' ability to synthesize the growing body of literature. Can large language models (LMs) assist scientists in this task? We introduce OpenScholar, a specialized retrieval-augmented LM that answers scientific queries by identifying relevant passages from 45 million open-access papers and synthesizing citation-backed responses. To evaluate OpenScholar, we develop ScholarQABench, the first large-scale multi-domain benchmark for literature search, comprising 2,967 expert-written queries and 208 long-form answers across computer science, physics, neuroscience, and biomedicine. On ScholarQABench, OpenScholar-8B outperforms GPT-4o by 5% and PaperQA2 by 7% in correctness, despite being a smaller, open model. While GPT4o hallucinates citations 78 to 90% of the time, OpenScholar achieves citation accuracy on par with human experts. OpenScholar's datastore, retriever, and self-feedback inference loop also improves off-the-shelf LMs: for instance, OpenScholar-GPT4o improves GPT-4o's correctness by 12%. In human evaluations, experts preferred OpenScholar-8B and OpenScholar-GPT4o responses over expert-written ones 51% and 70% of the time, respectively, compared to GPT4o's 32%. We open-source all of our code, models, datastore, data and a public demo. △ Less

Submitted 21 November, 2024; originally announced November 2024.

Simple But Not Secure: An Empirical Security Analysis of Two-factor Authentication Systems

Authors: Zhi Wang, Xin Yang, Du Chen, Han Gao, Meiqi Tian, Yan Jia, Wanpeng Li

Abstract: To protect users from data breaches and phishing attacks, service providers typically implement two-factor authentication (2FA) to add an extra layer of security against suspicious login attempts. However, since 2FA can sometimes hinder user experience by introducing additional steps, many websites aim to reduce inconvenience by minimizing the frequency of 2FA prompts. One approach to achieve this… ▽ More To protect users from data breaches and phishing attacks, service providers typically implement two-factor authentication (2FA) to add an extra layer of security against suspicious login attempts. However, since 2FA can sometimes hinder user experience by introducing additional steps, many websites aim to reduce inconvenience by minimizing the frequency of 2FA prompts. One approach to achieve this is by storing the user's ``Remember the Device'' preference in a cookie. As a result, users are only prompted for 2FA when this cookie expires or if they log in from a new device. To understand and improve the security of 2FA systems in real-world settings, we propose SE2FA, a vulnerability evaluation framework designed to detect vulnerabilities in 2FA systems. This framework enables us to analyze the security of 407 2FA systems across popular websites from the Tranco Top 10,000 list. Our analysis and evaluation found three zero-day vulnerabilities on three service providers that could allow an attacker to access a victim's account without possessing the victim's second authentication factor, thereby bypassing 2FA protections entirely. A further investigation found that these vulnerabilities stem from design choices aimed at simplifying 2FA for users but that unintentionally reduce its security effectiveness. We have disclosed these findings to the affected websites and assisted them in mitigating the risks. Based on the insights from this research, we provide practical recommendations for countermeasures to strengthen 2FA security and address these newly identified threats. △ Less

Submitted 18 November, 2024; originally announced November 2024.

STOP: Spatiotemporal Orthogonal Propagation for Weight-Threshold-Leakage Synergistic Training of Deep Spiking Neural Networks

Authors: Haoran Gao, Xichuan Zhou, Yingcheng Lin, Min Tian, Liyuan Liu, Cong Shi

Abstract: The prevailing of artificial intelligence-of-things calls for higher energy-efficient edge computing paradigms, such as neuromorphic agents leveraging brain-inspired spiking neural network (SNN) models based on spatiotemporally sparse binary spikes. However, the lack of efficient and high-accuracy deep SNN learning algorithms prevents them from practical edge deployments at a strictly bounded cost… ▽ More The prevailing of artificial intelligence-of-things calls for higher energy-efficient edge computing paradigms, such as neuromorphic agents leveraging brain-inspired spiking neural network (SNN) models based on spatiotemporally sparse binary spikes. However, the lack of efficient and high-accuracy deep SNN learning algorithms prevents them from practical edge deployments at a strictly bounded cost. In this paper, we propose the spatiotemporal orthogonal propagation (STOP) algorithm to tackle this challenge. Our algorithm enables fully synergistic learning of synaptic weights as well as firing thresholds and leakage factors in spiking neurons to improve SNN accuracy, in a unified temporally-forward trace-based framework to mitigate the huge memory requirement for storing neural states across all time-steps in the forward pass. Characteristically, the spatially-backward neuronal errors and temporally-forward traces propagate orthogonally to and independently of each other, substantially reducing computational complexity. Our STOP algorithm obtained high recognition accuracies of 94.84%, 74.92%, 98.26% and 77.10% on the CIFAR-10, CIFAR-100, DVS-Gesture and DVS-CIFAR10 datasets with adequate deep convolutional SNNs of VGG-11 or ResNet-18 structures. Compared with other deep SNN training algorithms, our method is more plausible for edge intelligent scenarios where resources are limited but high-accuracy in-situ learning is desired. △ Less

Submitted 27 November, 2024; v1 submitted 17 November, 2024; originally announced November 2024.

Comments: 13 pages (exclude supplementary), 5 figures

Anomalous-Hall Neel textures in altermagnetic materials

Authors: Rui-Chun Xiao, Hui Li, Hui Han, Wei Gan, Mengmeng Yang, Ding-Fu Shao, Shu-Hui Zhang, Yang Gao, Mingliang Tian, Jianhui Zhou

Abstract: Recently, the altermagnets, a new kind of colinear antiferromagnet with zero net magnetization and momentum-dependent spin-splitting of bands, have sparked great interest. Despite simple magnetic structures, these altermagnets exhibit intriguing and intricate dependence of AHE on the Néel vector, in contrast to the conventional perpendicular configuration of Hall current with magnetization in ferr… ▽ More Recently, the altermagnets, a new kind of colinear antiferromagnet with zero net magnetization and momentum-dependent spin-splitting of bands, have sparked great interest. Despite simple magnetic structures, these altermagnets exhibit intriguing and intricate dependence of AHE on the Néel vector, in contrast to the conventional perpendicular configuration of Hall current with magnetization in ferromagnets. In spite of being a crucial aspect in AHE research, the relationship between the AHE and the Néel vector remains largely elusive. Here, we propose a powerful "extrinsic parameter" method and further reveal diverse unconventional anomalous Hall textures in the Néel vector space, dubbed anomalous-Hall Néel textures (AHNTs) for altermagnets. Notably, we find that AHNTs resemble the spin textures in momentum space, and further reveal their symmetry origin. We identify 10 types across four categories of AHNTs in altermagnets. Meanwhile, we examine our key discoveries in prototypical altermagnets. Our work offers a complete classification of AHNTs and a thorough understanding of AHE in altermagnets. △ Less

Submitted 6 March, 2025; v1 submitted 15 November, 2024; originally announced November 2024.

Collective Pinning and Vortex Dynamics in type 2 superconducting thin films with Varying Magnetic Field

Authors: Yu Wu, Liangliang Guo, Renfei Wang, Jiawei Guo, Shuang Jia, Mingliang Tian, Xiaobo Lu, Hangwen Guo, Jian Shen, Yang Liu

Abstract: A perpendicular magnetic field penetrating a thin type-II superconductor slab produces vortices, with one vortex per flux quantum, h/2e. The vortices interact repulsively and form an ordered array (Abrikosov lattice) in clean systems, while strong disorder changes the lattice into a vortex glass. Here we investigate type-II superconducting films (PdBi2 and NbSe2) with surface acoustic waves (SAWs)… ▽ More A perpendicular magnetic field penetrating a thin type-II superconductor slab produces vortices, with one vortex per flux quantum, h/2e. The vortices interact repulsively and form an ordered array (Abrikosov lattice) in clean systems, while strong disorder changes the lattice into a vortex glass. Here we investigate type-II superconducting films (PdBi2 and NbSe2) with surface acoustic waves (SAWs) at mK temperature. When sweeping the magnetic field at an extremely slow rate, we observe a series of spikes in the attenuation and velocity of the SAW, on average separated in field by approximately Hc1. We suspect the following scenario: The vortex-free region at the edges of the film produces an edge barrier across which the vortices can enter or leave. When the applied field changes, the induced supercurrents flowing along this edge region lowers this barrier until there is an instability. At that point, vortices avalanche into (or out of) the bulk and change the vortex crystal, suggested by the sharp jump in each such spike. The vortices then gradually relax to a new stable pinned configuration, leading to a ~30s relaxation after the jump. Our observation enriches the limited experimental evidence on the important topic of real-time vortex dynamics in superconductors. △ Less

Submitted 11 November, 2024; v1 submitted 8 November, 2024; originally announced November 2024.

Observation of Giant Nernst plateau in ideal 1D Weyl Phase

Authors: Yong Zhang, Qi Li, Penglu Zhao, Yingcai Qian, Yangyang Lv, Yanbin Chen, Qian Niu, Haizhou Lu, Jinglei Zhang, Mingliang Tian

Abstract: The search for a giant Nernst effect beyond conventional mechanisms offers advantages for developing advanced thermoelectric devices and understanding charge-entropy conversion. Here, we study the Seebeck and Nernst effects of HfTe5 over a wide range of magnetic fields. By tracking the unusual magneto-thermoelectric responses, we reveal two magnetic-field-driven phase transitions proposed for weak… ▽ More The search for a giant Nernst effect beyond conventional mechanisms offers advantages for developing advanced thermoelectric devices and understanding charge-entropy conversion. Here, we study the Seebeck and Nernst effects of HfTe5 over a wide range of magnetic fields. By tracking the unusual magneto-thermoelectric responses, we reveal two magnetic-field-driven phase transitions proposed for weak topological insulators: the gap-closing transition of the zeroth Landau bands and the topological Lifshitz transition. After the magnetic fields exceed approximately ten times the quantum limit, we observe that the Nernst signal no longer varies with the fields, forming a plateau with a remarkably large value, reaching up to 50 μV/K at 2 K. We theoretically explain the giant Nernst plateau as a unique signature of the ideal 1D Weyl phase formed in such high fields. Our findings expand the understanding of ideal Weyl physics and open new avenues for realizing novel thermoelectric effects without fundamental constraints. △ Less

Submitted 14 October, 2024; originally announced October 2024.

Obelia: Scaling DAG-Based Blockchains to Hundreds of Validators

Authors: George Danezis, Lefteris Kokoris-Kogias, Alberto Sonnino, Mingwei Tian

Abstract: Obelia improves upon structured DAG-based consensus protocols used in proof-of-stake systems, allowing them to effectively scale to accommodate hundreds of validators. Obelia implements a two-tier validator system. A core group of high-stake validators that propose blocks as in current protocols and a larger group of lower-stake auxiliary validators that occasionally author blocks. Obelia incentiv… ▽ More Obelia improves upon structured DAG-based consensus protocols used in proof-of-stake systems, allowing them to effectively scale to accommodate hundreds of validators. Obelia implements a two-tier validator system. A core group of high-stake validators that propose blocks as in current protocols and a larger group of lower-stake auxiliary validators that occasionally author blocks. Obelia incentivizes auxiliary validators to assist recovering core validators and integrates seamlessly with existing protocols. We show that Obelia does not introduce visible overhead compared to the original protocol, even when scaling to hundreds of validators, or when a large number of auxiliary validators are unreliable. △ Less

Submitted 5 November, 2024; v1 submitted 11 October, 2024; originally announced October 2024.

Ion-Assisted Nanoscale Material Engineering in Atomic Layers

Authors: Hossein Taghinejad, Mohammad Taghinejad, Sajjad Abdollahramezani, Qitong Li, Eric V. Woods, Mengkun Tian, Ali A. Eftekhar, Yuanqi Lyu, Xiang Zhang, Pulickel M. Ajayan, Wenshan Cai, Mark L. Brongersma, James G. Analytis, Ali Adibi

Abstract: Achieving deterministic control over the properties of low-dimensional materials with nanoscale precision is a long-sought goal. Mastering this capability has a transformative impact on the design of multifunctional electrical and optical devices. Here, we present an ion-assisted synthetic technique that enables precise control over the material composition and energy landscape of two-dimensional… ▽ More Achieving deterministic control over the properties of low-dimensional materials with nanoscale precision is a long-sought goal. Mastering this capability has a transformative impact on the design of multifunctional electrical and optical devices. Here, we present an ion-assisted synthetic technique that enables precise control over the material composition and energy landscape of two-dimensional (2D) atomic crystals. Our method transforms binary transition metal dichalcogenides (TMDs), like MoSe$_2$, into ternary MoS$_{2α}$Se$_{2(1-α})$ alloys with systematically adjustable compositions, $α$. By piecewise assembly of the lateral, compositionally modulated MoS$_{2α}$Se$_{2(1-α)}$ segments within 2D atomic layers, we present a synthetic pathway towards the realization of multi-compositional designer materials. Our technique enables the fabrication of complex structures with arbitrary boundaries, dimensions as small as 30 nm, and fully customizable energy landscapes. Our optical characterizations further showcase the potential for implementing tailored optoelectronics in these engineered 2D crystals. △ Less

Submitted 8 October, 2024; originally announced October 2024.

Comments: 22 pages, 5 Figures

Expediting and Elevating Large Language Model Reasoning via Hidden Chain-of-Thought Decoding

Authors: Tianqiao Liu, Zui Chen, Zitao Liu, Mi Tian, Weiqi Luo

Abstract: Large language models (LLMs) have demonstrated remarkable capabilities in tasks requiring reasoning and multi-step problem-solving through the use of chain-of-thought (CoT) prompting. However, generating the full CoT process results in significantly longer output sequences, leading to increased computational costs and latency during inference. To address this challenge, we propose a novel approach… ▽ More Large language models (LLMs) have demonstrated remarkable capabilities in tasks requiring reasoning and multi-step problem-solving through the use of chain-of-thought (CoT) prompting. However, generating the full CoT process results in significantly longer output sequences, leading to increased computational costs and latency during inference. To address this challenge, we propose a novel approach to compress the CoT process through semantic alignment, enabling more efficient decoding while preserving the benefits of CoT reasoning. Our method introduces an auxiliary CoT model that learns to generate and compress the full thought process into a compact special token representation semantically aligned with the original CoT output. This compressed representation is then integrated into the input of the Hidden Chain-of-Thought (HCoT) model. The training process follows a two-stage procedure: First, the CoT model is optimized to generate the compressed token representations aligned with the ground-truth CoT outputs using a contrastive loss. Subsequently, with the CoT model parameters frozen, the HCoT model is fine-tuned to generate accurate subsequent predictions conditioned on the prefix instruction and the compressed CoT representations from the CoT model. Extensive experiments across three challenging domains - mathematical reasoning, agent invocation, and question answering - demonstrate that our semantic compression approach achieves competitive or improved performance compared to the full CoT baseline, while providing significant speedups of at least 1.5x in decoding time. Moreover, incorporating contrastive learning objectives further enhances the quality of the compressed representations, leading to better CoT prompting and improved task accuracy. Our work paves the way for more efficient exploitation of multi-step reasoning capabilities in LLMs across a wide range of applications. △ Less

Submitted 13 September, 2024; originally announced September 2024.

Classifying Multipartite Continuous Variable Entanglement Structures through Data-augmented Neural Networks

Authors: Xiaoting Gao, Mingsheng Tian, Feng-Xiao Sun, Ya-Dong Wu, Yu Xiang, Qiongyi He

Abstract: Neural networks have emerged as a promising paradigm for quantum information processing, yet they confront the challenge of generating training datasets with sufficient size and rich diversity, which is particularly acute when dealing with multipartite quantum systems. For instance, in the task of classifying different structures of multipartite entanglement in continuous variable systems, it is n… ▽ More Neural networks have emerged as a promising paradigm for quantum information processing, yet they confront the challenge of generating training datasets with sufficient size and rich diversity, which is particularly acute when dealing with multipartite quantum systems. For instance, in the task of classifying different structures of multipartite entanglement in continuous variable systems, it is necessary to simulate a large number of infinite-dimension state data that can cover as many types of non-Gaussian states as possible. Here, we develop a data-augmented neural network to complete this task with homodyne measurement data. A quantum data augmentation method based on classical data processing techniques and quantum physical principles is proposed to efficiently enhance the network performance. By testing on randomly generated tripartite and quadripartite states, we demonstrate that the network can indicate the entanglement structure among the various partitions and the accuracies are significantly improved with data augmentation. Our approach allows us to further extend the use of data-driven machine learning techniques to more complex tasks of learning quantum systems encoded in a large Hilbert space. △ Less

Submitted 29 October, 2024; v1 submitted 12 September, 2024; originally announced September 2024.

FePd2Te2: An Anisotropic Two-Dimensional Ferromagnet with One-Dimensional Fe Chains

Authors: Bingxian Shi, Yanyan Geng, Hengning Wang, Jianhui Yang, Chenglin Shang, Manyu Wang, Shuo Mi, Jiale Huang, Feihao Pan, Xuejuan Gui, Jinchen Wang, Juanjuan Liu, Daye Xu, Hongxia Zhang, Jianfei Qin, Hongliang Wang, Lijie Hao, Mingliang Tian, Zhihai Cheng, Guolin Zheng, Peng Cheng

Abstract: Two-dimensional (2D) magnets have attracted significant attentions in recent years due to their importance in the research on both fundamental physics and spintronic applications. Here, we report the discovery of a new ternary compound FePd2Te2. It features a layered quasi-2D crystal structure with one-dimensional Fe zigzag chains extending along the b-axis in the cleavage plane. Single crystals o… ▽ More Two-dimensional (2D) magnets have attracted significant attentions in recent years due to their importance in the research on both fundamental physics and spintronic applications. Here, we report the discovery of a new ternary compound FePd2Te2. It features a layered quasi-2D crystal structure with one-dimensional Fe zigzag chains extending along the b-axis in the cleavage plane. Single crystals of FePd2Te2 with centimeter-size could be grown. Density functional theory calculations, mechanical exfoliation and atomic force microscopy on these crystals reveal that they are 2D materialsthat can be thinned down to 5 nm. Magnetic characterization shows that FePd2Te2 is an easy-plane ferromagnet with Tc 183 K and strong in-plane uniaxial magnetic anisotropy. Magnetoresistance and anomalous Hall effect demonstrate that ferromagnetism could maintain in FePd2Te2 flakes with large coercivity. A crystal twinning effect is observed by scanning tunneling microscopy which makes the Fe chains right-angle bent in the cleavage plane and creates an intriguing spin texture. Our results show that FePd2Te2 is a correlated anisotropic 2D magnets that may attract multidisciplinary research interests. △ Less

Submitted 7 September, 2024; originally announced September 2024.

Journal ref: J.Am.Chem.Soc.2024,146,21546-21554

Characterizing the Multipartite Entanglement Structure of Non-Gaussian Continuous-Variable States with a Single Evolution Operator

Authors: Mingsheng Tian, Xiaoting Gao, Boxuan Jing, Feng-Xiao Sun, Matteo Fadel, Manuel Gessner, Qiongyi He

Abstract: Multipartite entanglement is an essential resource for quantum information tasks, but characterizing entanglement structures in continuous variable systems remains challenging, especially in multimode non-Gaussian scenarios. In this work, we introduce an efficient method for detecting multipartite entanglement structures in continuous-variable states. Based on the quantum Fisher information, we pr… ▽ More Multipartite entanglement is an essential resource for quantum information tasks, but characterizing entanglement structures in continuous variable systems remains challenging, especially in multimode non-Gaussian scenarios. In this work, we introduce an efficient method for detecting multipartite entanglement structures in continuous-variable states. Based on the quantum Fisher information, we propose a systematic approach to identify an optimal encoding operator that can capture the quantum correlations in multimode non-Gaussian states. We demonstrate the effectiveness of our method on over $10^5$ randomly generated multimode-entangled quantum states, achieving a very high success rate in entanglement detection. Additionally, the robustness of our method can be considerably enhanced against losses by expanding the set of accessible operators. This work provides a general framework for characterizing entanglement structures in diverse continuous variable systems, enabling a number of experimentally relevant applications. △ Less

Submitted 19 December, 2024; v1 submitted 22 August, 2024; originally announced August 2024.

SciCode: A Research Coding Benchmark Curated by Scientists

Authors: Minyang Tian, Luyu Gao, Shizhuo Dylan Zhang, Xinan Chen, Cunwei Fan, Xuefei Guo, Roland Haas, Pan Ji, Kittithat Krongchon, Yao Li, Shengyan Liu, Di Luo, Yutao Ma, Hao Tong, Kha Trinh, Chenyu Tian, Zihan Wang, Bohao Wu, Yanyu Xiong, Shengzhu Yin, Minhui Zhu, Kilian Lieret, Yanxin Lu, Genglin Liu, Yufeng Du , et al. (5 additional authors not shown)

Abstract: Since language models (LMs) now outperform average humans on many challenging tasks, it has become increasingly difficult to develop challenging, high-quality, and realistic evaluations. We address this issue by examining LMs' capabilities to generate code for solving real scientific research problems. Incorporating input from scientists and AI researchers in 16 diverse natural science sub-fields,… ▽ More Since language models (LMs) now outperform average humans on many challenging tasks, it has become increasingly difficult to develop challenging, high-quality, and realistic evaluations. We address this issue by examining LMs' capabilities to generate code for solving real scientific research problems. Incorporating input from scientists and AI researchers in 16 diverse natural science sub-fields, including mathematics, physics, chemistry, biology, and materials science, we created a scientist-curated coding benchmark, SciCode. The problems in SciCode naturally factorize into multiple subproblems, each involving knowledge recall, reasoning, and code synthesis. In total, SciCode contains 338 subproblems decomposed from 80 challenging main problems. It offers optional descriptions specifying useful scientific background information and scientist-annotated gold-standard solutions and test cases for evaluation. Claude3.5-Sonnet, the best-performing model among those tested, can solve only 4.6% of the problems in the most realistic setting. We believe that SciCode demonstrates both contemporary LMs' progress towards becoming helpful scientific assistants and sheds light on the development and evaluation of scientific AI in the future. △ Less

Submitted 18 July, 2024; originally announced July 2024.

Comments: 25 pages, 9 figures, 7 tables

Path-Specific Causal Reasoning for Fairness-aware Cognitive Diagnosis

Authors: Dacao Zhang, Kun Zhang, Le Wu, Mi Tian, Richang Hong, Meng Wang

Abstract: Cognitive Diagnosis~(CD), which leverages students and exercise data to predict students' proficiency levels on different knowledge concepts, is one of fundamental components in Intelligent Education. Due to the scarcity of student-exercise interaction data, most existing methods focus on making the best use of available data, such as exercise content and student information~(e.g., educational con… ▽ More Cognitive Diagnosis~(CD), which leverages students and exercise data to predict students' proficiency levels on different knowledge concepts, is one of fundamental components in Intelligent Education. Due to the scarcity of student-exercise interaction data, most existing methods focus on making the best use of available data, such as exercise content and student information~(e.g., educational context). Despite the great progress, the abuse of student sensitive information has not been paid enough attention. Due to the important position of CD in Intelligent Education, employing sensitive information when making diagnosis predictions will cause serious social issues. Moreover, data-driven neural networks are easily misled by the shortcut between input data and output prediction, exacerbating this problem. Therefore, it is crucial to eliminate the negative impact of sensitive information in CD models. In response, we argue that sensitive attributes of students can also provide useful information, and only the shortcuts directly related to the sensitive information should be eliminated from the diagnosis process. Thus, we employ causal reasoning and design a novel Path-Specific Causal Reasoning Framework (PSCRF) to achieve this goal. Specifically, we first leverage an encoder to extract features and generate embeddings for general information and sensitive information of students. Then, we design a novel attribute-oriented predictor to decouple the sensitive attributes, in which fairness-related sensitive features will be eliminated and other useful information will be retained. Finally, we designed a multi-factor constraint to ensure the performance of fairness and diagnosis performance simultaneously. Extensive experiments over real-world datasets (e.g., PISA dataset) demonstrate the effectiveness of our proposed PSCRF. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Comments: Accpeted by KDD'2024

Isotope substitution and polytype control for point defects identification: the case of the ultraviolet color center in hexagonal boron nitride

Authors: J. Plo, A. Pershin, S. Li, T. Poirier, E. Janzen, H. Schutte, M. Tian, M. Wynn, S. Bernard, A. Rousseau, A. Ibanez, P. Valvin, W. Desrat, T. Michel, V. Jacques, B. Gil, A. Kaminska, N. Wan, J. H. Edgar, A. Gali, G. Cassabois

Abstract: Defects in crystals can have a transformative effect on the properties and functionalities of solid-state systems. Dopants in semiconductors are core components in electronic and optoelectronic devices. The control of single color centers is at the basis of advanced applications for quantum technologies. Unintentional defects can also be detrimental to the crystalline structure and hinder the deve… ▽ More Defects in crystals can have a transformative effect on the properties and functionalities of solid-state systems. Dopants in semiconductors are core components in electronic and optoelectronic devices. The control of single color centers is at the basis of advanced applications for quantum technologies. Unintentional defects can also be detrimental to the crystalline structure and hinder the development of novel materials. Whatever the research perspective, the identification of defects is a key but complicated, and often long-standing issue. Here, we present a general methodology to identify point defects by combining isotope substitution and polytype control, with a systematic comparison between experiments and first-principles calculations. We apply this methodology to hexagonal boron nitride (hBN) and its ubiquitous color center emitting in the ultraviolet spectral range. From isotopic purification of the host hBN matrix, a local vibrational mode of the defect is uncovered, and isotope-selective carbon doping proves that this mode belongs to a carbon-based center. Then, by varying the stacking sequence of the host hBN matrix, we unveil different optical responses to hydrostatic pressure for the non-equivalent configurations of this ultraviolet color center. We conclude that this defect is a carbon dimer in the honeycomb lattice of hBN. Our results show that tuning the stacking sequence in different polytypes of a given crystal provides unique fingerprints contributing to the identification of defects in 2D materials. △ Less

Submitted 31 May, 2024; originally announced May 2024.

Automated Evaluation of Large Vision-Language Models on Self-driving Corner Cases

Authors: Kai Chen, Yanze Li, Wenhua Zhang, Yanxin Liu, Pengxiang Li, Ruiyuan Gao, Lanqing Hong, Meng Tian, Xinhai Zhao, Zhenguo Li, Dit-Yan Yeung, Huchuan Lu, Xu Jia

Abstract: Large Vision-Language Models (LVLMs) have received widespread attention for advancing the interpretable self-driving. Existing evaluations of LVLMs primarily focus on multi-faceted capabilities in natural circumstances, lacking automated and quantifiable assessment for self-driving, let alone the severe road corner cases. In this work, we propose CODA-LM, the very first benchmark for the automatic… ▽ More Large Vision-Language Models (LVLMs) have received widespread attention for advancing the interpretable self-driving. Existing evaluations of LVLMs primarily focus on multi-faceted capabilities in natural circumstances, lacking automated and quantifiable assessment for self-driving, let alone the severe road corner cases. In this work, we propose CODA-LM, the very first benchmark for the automatic evaluation of LVLMs for self-driving corner cases. We adopt a hierarchical data structure and prompt powerful LVLMs to analyze complex driving scenes and generate high-quality pre-annotations for the human annotators, while for LVLM evaluation, we show that using the text-only large language models (LLMs) as judges reveals even better alignment with human preferences than the LVLM judges. Moreover, with our CODA-LM, we build CODA-VLM, a new driving LVLM surpassing all open-sourced counterparts on CODA-LM. Our CODA-VLM performs comparably with GPT-4V, even surpassing GPT-4V by +21.42% on the regional perception task. We hope CODA-LM can become the catalyst to promote interpretable self-driving empowered by LVLMs. △ Less

Submitted 5 December, 2024; v1 submitted 16 April, 2024; originally announced April 2024.

Comments: Accept by WACV 2025. Project Page: https://coda-dataset.github.io/coda-lm/

An Enhanced Differential Grouping Method for Large-Scale Overlapping Problems

Authors: Maojiang Tian, Mingke Chen, Wei Du, Yang Tang, Yaochu Jin

Abstract: Large-scale overlapping problems are prevalent in practical engineering applications, and the optimization challenge is significantly amplified due to the existence of shared variables. Decomposition-based cooperative coevolution (CC) algorithms have demonstrated promising performance in addressing large-scale overlapping problems. However, current CC frameworks designed for overlapping problems r… ▽ More Large-scale overlapping problems are prevalent in practical engineering applications, and the optimization challenge is significantly amplified due to the existence of shared variables. Decomposition-based cooperative coevolution (CC) algorithms have demonstrated promising performance in addressing large-scale overlapping problems. However, current CC frameworks designed for overlapping problems rely on grouping methods for the identification of overlapping problem structures and the current grouping methods for large-scale overlapping problems fail to consider both accuracy and efficiency simultaneously. In this article, we propose a two-stage enhanced grouping method for large-scale overlapping problems, called OEDG, which achieves accurate grouping while significantly reducing computational resource consumption. In the first stage, OEDG employs a grouping method based on the finite differences principle to identify all subcomponents and shared variables. In the second stage, we propose two grouping refinement methods, called subcomponent union detection (SUD) and subcomponent detection (SD), to enhance and refine the grouping results. SUD examines the information of the subcomponents and shared variables obtained in the previous stage, and SD corrects inaccurate grouping results. To better verify the performance of the proposed OEDG, we propose a series of novel benchmarks that consider various properties of large-scale overlapping problems, including the topology structure, overlapping degree, and separability. Extensive experimental results demonstrate that OEDG is capable of accurately grouping different types of large-scale overlapping problems while consuming fewer computational resources. Finally, we empirically verify that the proposed OEDG can effectively improve the optimization performance of diverse large-scale overlapping problems. △ Less

Submitted 16 April, 2024; originally announced April 2024.

Layer-by-layer connection for large area single crystal boron nitride multilayer films

Authors: Hui Shi, Mingyuan Wang, Hongying Chen, Adrien Rousseau, Junpeng Shu, Ming Tian, Ruowang Chen, Juliette Plo, Pierre Valvin, Bernard Gil, Jiajie Qi, Qinghe Wang, Kaihui Liu, Mingliang Zhang, Guillaume Cassabois, Di Wu, Neng Wan

Abstract: Boron nitride (BN) is today considered as one of the most promising materials for many novel applications including bright single photon emission, deep UV opto-electronics, small sized solid-state neutron detector, and high-performance two-dimensional materials, etc. Despite the recent successful fabrication of large-area BN single-crystals (typically <= 5 atomic layers), the scalable growth of th… ▽ More Boron nitride (BN) is today considered as one of the most promising materials for many novel applications including bright single photon emission, deep UV opto-electronics, small sized solid-state neutron detector, and high-performance two-dimensional materials, etc. Despite the recent successful fabrication of large-area BN single-crystals (typically <= 5 atomic layers), the scalable growth of thicker single-crystalline BN films still constitutes a great challenge. In this work, we demonstrate an approach to grow large-area multilayer single-crystal BN films by chemical vapor deposition on face-centered cubic Fe-Ni (111) single crystal alloy thin films with different stoichiometric phases. We show that the BN growth is greatly tunable and improved by increasing the Fe content in single-crystal Fe-Ni (111). The formation of pyramid-shaped multilayer BN domains with aligned orientation enables a continuous connection following a layer-by-layer, 'first-meet-first-connect', mosaic stitching mechanism. By means of selected area electron diffraction, micro-photoluminescence spectroscopy in the deep UV and high-resolution transmission electron microscopy, the layer-by-layer connection mechanism is unambiguously evidenced, and the stacking order has been verified to occur as unidirectional AB and ABC stackings, i.e., in the Bernal and rhombohedral BN phase. △ Less

Submitted 12 April, 2024; originally announced April 2024.

Electrically tunable, rapid spin-orbit torque induced modulation of colossal magnetoresistance in Mn$_3$Si$_2$Te$_6$ nanoflakes

Authors: Cheng Tan, Mingxun Deng, Yuanjun Yang, Linlin An, Weifeng Ge, Sultan Albarakati, Majid Panahandeh-Fard, James Partridge, Dimitrie Culcer, Bin Lei, Tao Wu, Xiangde Zhu, Mingliang Tian, Xianhui Chen, Rui-Qiang Wang, Lan Wang

Abstract: As a quasi-layered ferrimagnetic material, Mn$_3$Si$_2$Te$_6$ nanoflakes exhibit magnetoresistance behaviour that is fundamentally different from their bulk crystal counterparts. They offer three key properties crucial for spintronics. Firstly, at least 10^6 times faster response comparing to that exhibited by bulk crystals has been observed in current-controlled resistance and magnetoresistance.… ▽ More As a quasi-layered ferrimagnetic material, Mn$_3$Si$_2$Te$_6$ nanoflakes exhibit magnetoresistance behaviour that is fundamentally different from their bulk crystal counterparts. They offer three key properties crucial for spintronics. Firstly, at least 10^6 times faster response comparing to that exhibited by bulk crystals has been observed in current-controlled resistance and magnetoresistance. Secondly, ultra-low current density is required for resistance modulation (~ 5 A/cm$^2$). Thirdly, electrically gate-tunable magnetoresistance has been realized. Theoretical calculations reveal that the unique magnetoresistance behaviour in the Mn$_3$Si$_2$Te$_6$ nanoflakes arises from a magnetic field induced band gap shift across the Fermi level. The rapid current induced resistance variation is attributed to spin-orbit torque, an intrinsically ultra-fast process (~nanoseconds). This study suggests promising avenues for spintronic applications. In addition, it highlights Mn$_3$Si$_2$Te$_6$ nanoflakes as a suitable platform for investigating the intriguing physics underlying chiral orbital moments, magnetic field induced band variation and spin torque. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Comments: 22 pages,4 figures

Multi-photon super-linear image scanning microscopy using upconversion nanoparticles

Authors: Yao Wang, Baolei Liu, Lei Ding, Chaohao Chen, Xuchen Shan, Dajing Wang, Menghan Tian, Jiaqi Song, Ze Zheng, Xiaoxue Xu, Xiaolan Zhong, Fan Wang

Abstract: Super-resolution fluorescence microscopy is of great interest in life science studies for visualizing subcellular structures at the nanometer scale. Among various kinds of super-resolution approaches, image scanning microscopy (ISM) offers a doubled resolution enhancement in a simple and straightforward manner, based on the commonly used confocal microscopes. ISM is also suitable to be integrated… ▽ More Super-resolution fluorescence microscopy is of great interest in life science studies for visualizing subcellular structures at the nanometer scale. Among various kinds of super-resolution approaches, image scanning microscopy (ISM) offers a doubled resolution enhancement in a simple and straightforward manner, based on the commonly used confocal microscopes. ISM is also suitable to be integrated with multi-photon microscopy techniques, such as two-photon excitation and second-harmonic generation imaging, for deep tissue imaging, but it remains the twofold limited resolution enhancement and requires expensive femtosecond lasers. Here, we present and experimentally demonstrate the super-linear ISM (SL-ISM) to push the resolution enhancement beyond the factor of two, with a single low-power, continuous-wave, and near-infrared laser, by harnessing the emission nonlinearity within the multiphoton excitation process of lanthanide-doped upconversion nanoparticles (UCNPs). Based on a modified confocal microscope, we achieve a resolution of about 120 nm, 1/8th of the excitation wavelength. Furthermore, we demonstrate a parallel detection strategy of SL-ISM with the multifocal structured excitation pattern, to speed up the acquisition frame rate. This method suggests a new perspective for super-resolution imaging or sensing, multi-photon imaging, and deep-tissue imaging with simple, low-cost, and straightforward implementations. △ Less

Submitted 20 March, 2024; originally announced March 2024.

Comments: 9 pages, 4 figures

Journal ref: Laser & Photonics Reviews, 2024, 2400746

A Composite Decomposition Method for Large-Scale Global Optimization

Authors: Maojiang Tian, Minyang Chen, Wei Du, Yang Tang, Yaochu Jin, Gary G. Yen

Abstract: Cooperative co-evolution (CC) algorithms, based on the divide-and-conquer strategy, have emerged as the predominant approach to solving large-scale global optimization (LSGO) problems. The efficiency and accuracy of the grouping stage significantly impact the performance of the optimization process. While the general separability grouping (GSG) method has overcome the limitation of previous differ… ▽ More Cooperative co-evolution (CC) algorithms, based on the divide-and-conquer strategy, have emerged as the predominant approach to solving large-scale global optimization (LSGO) problems. The efficiency and accuracy of the grouping stage significantly impact the performance of the optimization process. While the general separability grouping (GSG) method has overcome the limitation of previous differential grouping (DG) methods by enabling the decomposition of non-additively separable functions, it suffers from high computational complexity. To address this challenge, this article proposes a composite separability grouping (CSG) method, seamlessly integrating DG and GSG into a problem decomposition framework to utilize the strengths of both approaches. CSG introduces a step-by-step decomposition framework that accurately decomposes various problem types using fewer computational resources. By sequentially identifying additively, multiplicatively and generally separable variables, CSG progressively groups non-separable variables by recursively considering the interactions between each non-separable variable and the formed non-separable groups. Furthermore, to enhance the efficiency and accuracy of CSG, we introduce two innovative methods: a multiplicatively separable variable detection method and a non-separable variable grouping method. These two methods are designed to effectively detect multiplicatively separable variables and efficiently group non-separable variables, respectively. Extensive experimental results demonstrate that CSG achieves more accurate variable grouping with lower computational complexity compared to GSG and state-of-the-art DG series designs. △ Less

Submitted 8 March, 2024; v1 submitted 2 March, 2024; originally announced March 2024.

Spatial Cascaded Clustering and Weighted Memory for Unsupervised Person Re-identification

Authors: Jiahao Hong, Jialong Zuo, Chuchu Han, Ruochen Zheng, Ming Tian, Changxin Gao, Nong Sang

Abstract: Recent unsupervised person re-identification (re-ID) methods achieve high performance by leveraging fine-grained local context. These methods are referred to as part-based methods. However, most part-based methods obtain local contexts through horizontal division, which suffer from misalignment due to various human poses. Additionally, the misalignment of semantic information in part features rest… ▽ More Recent unsupervised person re-identification (re-ID) methods achieve high performance by leveraging fine-grained local context. These methods are referred to as part-based methods. However, most part-based methods obtain local contexts through horizontal division, which suffer from misalignment due to various human poses. Additionally, the misalignment of semantic information in part features restricts the use of metric learning, thus affecting the effectiveness of part-based methods. The two issues mentioned above result in the under-utilization of part features in part-based methods. We introduce the Spatial Cascaded Clustering and Weighted Memory (SCWM) method to address these challenges. SCWM aims to parse and align more accurate local contexts for different human body parts while allowing the memory module to balance hard example mining and noise suppression. Specifically, we first analyze the foreground omissions and spatial confusions issues in the previous method. Then, we propose foreground and space corrections to enhance the completeness and reasonableness of the human parsing results. Next, we introduce a weighted memory and utilize two weighting strategies. These strategies address hard sample mining for global features and enhance noise resistance for part features, which enables better utilization of both global and part features. Extensive experiments on Market-1501 and MSMT17 validate the proposed method's effectiveness over many state-of-the-art methods. △ Less

Submitted 29 February, 2024; originally announced March 2024.

LoRATK: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystem

Authors: Hongyi Liu, Shaochen Zhong, Xintong Sun, Minghao Tian, Mohsen Hariri, Zirui Liu, Ruixiang Tang, Zhimeng Jiang, Jiayi Yuan, Yu-Neng Chuang, Li Li, Soo-Hyun Choi, Rui Chen, Vipin Chaudhary, Xia Hu

Abstract: Finetuning LLMs with LoRA has gained significant popularity due to its simplicity and effectiveness. Often, users may even find pluggable, community-shared LoRAs to enhance their base models for a specific downstream task of interest; enjoying a powerful, efficient, yet customized LLM experience with negligible investment. However, this convenient share-and-play ecosystem also introduces a new att… ▽ More Finetuning LLMs with LoRA has gained significant popularity due to its simplicity and effectiveness. Often, users may even find pluggable, community-shared LoRAs to enhance their base models for a specific downstream task of interest; enjoying a powerful, efficient, yet customized LLM experience with negligible investment. However, this convenient share-and-play ecosystem also introduces a new attack surface, where attackers can distribute malicious LoRAs to a community eager to try out shared assets. Despite the high-risk potential, no prior art has comprehensively explored LoRA's attack surface under the downstream-enhancing share-and-play context. In this paper, we investigate how backdoors can be injected into task-enhancing LoRAs and examine the mechanisms of such infections. We find that with a simple, efficient, yet specific recipe, a backdoor LoRA can be trained once and then seamlessly merged (in a training-free fashion) with multiple task-enhancing LoRAs, retaining both its malicious backdoor and benign downstream capabilities. This allows attackers to scale the distribution of compromised LoRAs with minimal effort by leveraging the rich pool of existing shared LoRA assets. We note that such merged LoRAs are particularly infectious -- because their malicious intent is cleverly concealed behind improved downstream capabilities, creating a strong incentive for voluntary download -- and dangerous -- because under local deployment, no safety measures exist to intervene when things go wrong. Our work is among the first to study this new threat model of training-free distribution of downstream-capable-yet-backdoor-injected LoRAs, highlighting the urgent need for heightened security awareness in the LoRA ecosystem. Warning: This paper contains offensive content and involves a real-life tragedy. △ Less

Submitted 30 April, 2025; v1 submitted 29 February, 2024; originally announced March 2024.

StarCoder 2 and The Stack v2: The Next Generation

Authors: Anton Lozhkov, Raymond Li, Loubna Ben Allal, Federico Cassano, Joel Lamy-Poirier, Nouamane Tazi, Ao Tang, Dmytro Pykhtar, Jiawei Liu, Yuxiang Wei, Tianyang Liu, Max Tian, Denis Kocetkov, Arthur Zucker, Younes Belkada, Zijian Wang, Qian Liu, Dmitry Abulkhanov, Indraneil Paul, Zhuang Li, Wen-Ding Li, Megan Risdal, Jia Li, Jian Zhu, Terry Yue Zhuo , et al. (41 additional authors not shown)

Abstract: The BigCode project, an open-scientific collaboration focused on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder2. In partnership with Software Heritage (SWH), we build The Stack v2 on top of the digital commons of their source code archive. Alongside the SWH repositories spanning 619 programming languages, we carefully select other high-quality data… ▽ More The BigCode project, an open-scientific collaboration focused on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder2. In partnership with Software Heritage (SWH), we build The Stack v2 on top of the digital commons of their source code archive. Alongside the SWH repositories spanning 619 programming languages, we carefully select other high-quality data sources, such as GitHub pull requests, Kaggle notebooks, and code documentation. This results in a training set that is 4x larger than the first StarCoder dataset. We train StarCoder2 models with 3B, 7B, and 15B parameters on 3.3 to 4.3 trillion tokens and thoroughly evaluate them on a comprehensive set of Code LLM benchmarks. We find that our small model, StarCoder2-3B, outperforms other Code LLMs of similar size on most benchmarks, and also outperforms StarCoderBase-15B. Our large model, StarCoder2- 15B, significantly outperforms other models of comparable size. In addition, it matches or outperforms CodeLlama-34B, a model more than twice its size. Although DeepSeekCoder- 33B is the best-performing model at code completion for high-resource languages, we find that StarCoder2-15B outperforms it on math and code reasoning benchmarks, as well as several low-resource languages. We make the model weights available under an OpenRAIL license and ensure full transparency regarding the training data by releasing the SoftWare Heritage persistent IDentifiers (SWHIDs) of the source code data. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Miniaturized on-chip spectrometer enabled by electrochromic modulation

Authors: Menghan Tian, Baolei Liu, Zelin Lu, Yao Wang, Ze Zheng, Jiaqi Song, Xiaolan Zhong, Fan Wang

Abstract: Miniaturized on-chip spectrometers with small footprints, lightweight, and low cost are in great demand for portable optical sensing, lab-on-chip systems, and so on. Such miniaturized spectrometers are usually based on engineered spectral response units and then reconstruct unknown spectra with algorithms. However, due to the limited footprints of computational on-chip spectrometers, the recovered… ▽ More Miniaturized on-chip spectrometers with small footprints, lightweight, and low cost are in great demand for portable optical sensing, lab-on-chip systems, and so on. Such miniaturized spectrometers are usually based on engineered spectral response units and then reconstruct unknown spectra with algorithms. However, due to the limited footprints of computational on-chip spectrometers, the recovered spectral resolution is limited by the number of integrated spectral response units/filters. Thus, it is challenging to improve the spectral resolution without increasing the number of used filters. Here we present a computational on-chip spectrometer using electrochromic filters that can be electrochemically modulated to increase the efficient sampling number for higher spectral resolution. These filters are directly integrated on top of the photodetector pixels, and the spectral modulation of the filters results from redox reactions during the dual injection of ions and electrons into the electrochromic material. We experimentally demonstrate that the spectral resolution of the proposed spectrometer can be effectively improved as the number of applied voltages increases. The average difference of the peak wavelengths between the reconstructed and the reference spectra decreases from 14.48 nm to 2.57 nm. We also demonstrate the proposed spectrometer can be worked with only four or two filter units, assisted by electrochromic modulation. This strategy suggests a new way to enhance the performance of miniaturized spectrometers with tunable spectral filters for high resolution, low-cost, and portable spectral sensing, and would also inspire the exploration of other stimulus responses such as photochromic and force-chromic, etc, on computational spectrometers. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Comments: 10 pages, 5 figures

Journal ref: Light: Science & Applications, 13, 278 (2024)

The Random Forest Model for Analyzing and Forecasting the US Stock Market in the Context of Smart Finance

Authors: Jiajian Zheng, Duan Xin, Qishuo Cheng, Miao Tian, Le Yang

Abstract: The stock market is a crucial component of the financial market, playing a vital role in wealth accumulation for investors, financing costs for listed companies, and the stable development of the national macroeconomy. Significant fluctuations in the stock market can damage the interests of stock investors and cause an imbalance in the industrial structure, which can interfere with the macro level… ▽ More The stock market is a crucial component of the financial market, playing a vital role in wealth accumulation for investors, financing costs for listed companies, and the stable development of the national macroeconomy. Significant fluctuations in the stock market can damage the interests of stock investors and cause an imbalance in the industrial structure, which can interfere with the macro level development of the national economy. The prediction of stock price trends is a popular research topic in academia. Predicting the three trends of stock pricesrising, sideways, and falling can assist investors in making informed decisions about buying, holding, or selling stocks. Establishing an effective forecasting model for predicting these trends is of substantial practical importance. This paper evaluates the predictive performance of random forest models combined with artificial intelligence on a test set of four stocks using optimal parameters. The evaluation considers both predictive accuracy and time efficiency. △ Less

Submitted 26 February, 2024; originally announced February 2024.

Comments: 10 pages, 8 figures

AI-Driven Anonymization: Protecting Personal Data Privacy While Leveraging Machine Learning

Authors: Le Yang, Miao Tian, Duan Xin, Qishuo Cheng, Jiajian Zheng

Abstract: The development of artificial intelligence has significantly transformed people's lives. However, it has also posed a significant threat to privacy and security, with numerous instances of personal information being exposed online and reports of criminal attacks and theft. Consequently, the need to achieve intelligent protection of personal information through machine learning algorithms has becom… ▽ More The development of artificial intelligence has significantly transformed people's lives. However, it has also posed a significant threat to privacy and security, with numerous instances of personal information being exposed online and reports of criminal attacks and theft. Consequently, the need to achieve intelligent protection of personal information through machine learning algorithms has become a paramount concern. Artificial intelligence leverages advanced algorithms and technologies to effectively encrypt and anonymize personal data, enabling valuable data analysis and utilization while safeguarding privacy. This paper focuses on personal data privacy protection and the promotion of anonymity as its core research objectives. It achieves personal data privacy protection and detection through the use of machine learning's differential privacy protection algorithm. The paper also addresses existing challenges in machine learning related to privacy and personal data protection, offers improvement suggestions, and analyzes factors impacting datasets to enable timely personal data privacy detection and protection. △ Less

Submitted 26 February, 2024; originally announced February 2024.

Comments: 9 pages, 6 figures