-
EconGym: A Scalable AI Testbed with Diverse Economic Tasks
Authors:
Qirui Mi,
Qipeng Yang,
Zijun Fan,
Wentian Fan,
Heyang Ma,
Chengdong Ma,
Siyu Xia,
Bo An,
Jun Wang,
Haifeng Zhang
Abstract:
Artificial intelligence (AI) has become a powerful tool for economic research, enabling large-scale simulation and policy optimization. However, applying AI effectively requires simulation platforms for scalable training and evaluation-yet existing environments remain limited to simplified, narrowly scoped tasks, falling short of capturing complex economic challenges such as demographic shifts, mu…
▽ More
Artificial intelligence (AI) has become a powerful tool for economic research, enabling large-scale simulation and policy optimization. However, applying AI effectively requires simulation platforms for scalable training and evaluation-yet existing environments remain limited to simplified, narrowly scoped tasks, falling short of capturing complex economic challenges such as demographic shifts, multi-government coordination, and large-scale agent interactions. To address this gap, we introduce EconGym, a scalable and modular testbed that connects diverse economic tasks with AI algorithms. Grounded in rigorous economic modeling, EconGym implements 11 heterogeneous role types (e.g., households, firms, banks, governments), their interaction mechanisms, and agent models with well-defined observations, actions, and rewards. Users can flexibly compose economic roles with diverse agent algorithms to simulate rich multi-agent trajectories across 25+ economic tasks for AI-driven policy learning and analysis. Experiments show that EconGym supports diverse and cross-domain tasks-such as coordinating fiscal, pension, and monetary policies-and enables benchmarking across AI, economic methods, and hybrids. Results indicate that richer task composition and algorithm diversity expand the policy space, while AI agents guided by classical economic methods perform best in complex settings. EconGym also scales to 10k agents with high realism and efficiency.
△ Less
Submitted 13 June, 2025;
originally announced June 2025.
-
MF-LLM: Simulating Population Decision Dynamics via a Mean-Field Large Language Model Framework
Authors:
Qirui Mi,
Mengyue Yang,
Xiangning Yu,
Zhiyu Zhao,
Cheng Deng,
Bo An,
Haifeng Zhang,
Xu Chen,
Jun Wang
Abstract:
Simulating collective decision-making involves more than aggregating individual behaviors; it emerges from dynamic interactions among individuals. While large language models (LLMs) offer strong potential for social simulation, achieving quantitative alignment with real-world data remains a key challenge. To bridge this gap, we propose the Mean-Field LLM (MF-LLM) framework, the first to incorporat…
▽ More
Simulating collective decision-making involves more than aggregating individual behaviors; it emerges from dynamic interactions among individuals. While large language models (LLMs) offer strong potential for social simulation, achieving quantitative alignment with real-world data remains a key challenge. To bridge this gap, we propose the Mean-Field LLM (MF-LLM) framework, the first to incorporate mean field theory into LLM-based social simulation. MF-LLM models bidirectional interactions between individuals and the population through an iterative process, generating population signals to guide individual decisions, which in turn update the signals. This interplay produces coherent trajectories of collective behavior. To improve alignment with real-world data, we introduce IB-Tune, a novel fine-tuning method inspired by the Information Bottleneck principle, which retains population signals most predictive of future actions while filtering redundant history. Evaluated on a real-world social dataset, MF-LLM reduces KL divergence to human population distributions by 47\% compared to non-mean-field baselines, enabling accurate trend forecasting and effective intervention planning. Generalizing across 7 domains and 4 LLM backbones, MF-LLM provides a scalable, high-fidelity foundation for social simulation.
△ Less
Submitted 19 May, 2025; v1 submitted 30 April, 2025;
originally announced April 2025.
-
TflosYOLO+TFSC: An Accurate and Robust Model for Estimating Flower Count and Flowering Period
Authors:
Qianxi Mi,
Pengcheng Yuan,
Chunlei Ma,
Jiedan Chen,
Mingzhe Yao
Abstract:
Tea flowers play a crucial role in taxonomic research and hybrid breeding for the tea plant. As traditional methods of observing tea flower traits are labor-intensive and inaccurate, we propose TflosYOLO and TFSC model for tea flowering quantifying, which enable estimation of flower count and flowering period. In this study, a highly representative and diverse dataset was constructed by collecting…
▽ More
Tea flowers play a crucial role in taxonomic research and hybrid breeding for the tea plant. As traditional methods of observing tea flower traits are labor-intensive and inaccurate, we propose TflosYOLO and TFSC model for tea flowering quantifying, which enable estimation of flower count and flowering period. In this study, a highly representative and diverse dataset was constructed by collecting flower images from 29 tea accessions in 2 years. Based on this dataset, the TflosYOLO model was built on the YOLOv5 architecture and enhanced with the Squeeze-and-Excitation (SE) network, which is the first model to offer a viable solution for detecting and counting tea flowers. The TflosYOLO model achieved an mAP50 of 0.874, outperforming YOLOv5, YOLOv7 and YOLOv8. Furthermore, TflosYOLO model was tested on 34 datasets encompassing 26 tea accessions, five flowering stages, various lighting conditions, and pruned / unpruned plants, demonstrating high generalization and robustness. The correlation coefficient (R^2) between the predicted and actual flower counts was 0.974. Additionally, the TFSC (Tea Flowering Stage Classification) model, a 7-layer neural network was designed for automatic classification of the flowering period. TFSC model was evaluated on 2 years and achieved an accuracy of 0.738 and 0.899 respectively. Using the TflosYOLO+TFSC model, we monitored the tea flowering dynamics and tracked the changes in flowering stages across various tea accessions. The framework provides crucial support for tea plant breeding programs and phenotypic analysis of germplasm resources.
△ Less
Submitted 7 April, 2025; v1 submitted 25 January, 2025;
originally announced January 2025.
-
Resolving and routing the magnetic polymorphs in 2D layered antiferromagnet
Authors:
Zeyuan Sun,
Canyu Hong,
Yi Chen,
Zhiyuan Sheng,
Shuang Wu,
Zhanshan Wang,
Bokai Liang,
Wei-Tao Liu,
Zhe Yuan,
Yizheng Wu,
Qixi Mi,
Zhongkai Liu,
Jian Shen,
Shiwei Wu
Abstract:
Polymorphism, commonly denoting the variety of molecular or crystal structures, is a vital element in many natural science disciplines. In van der Waals layered antiferromagnets, a new type of magnetic polymorphism is allowed by having multiple layer-selective magnetic structures with the same total magnetization. However, resolving and manipulating such magnetic polymorphs remain a great challeng…
▽ More
Polymorphism, commonly denoting the variety of molecular or crystal structures, is a vital element in many natural science disciplines. In van der Waals layered antiferromagnets, a new type of magnetic polymorphism is allowed by having multiple layer-selective magnetic structures with the same total magnetization. However, resolving and manipulating such magnetic polymorphs remain a great challenge. Here we use the phase-resolved magnetic second-harmonic generation microscopy to elucidate such magnetic polymorphism in the 2D semiconducting layered antiferromagnet chromium sulfur bromide (CrSBr), and demonstrate how the magnetic polymorphs can be deterministically switched in an unprecedented layer-selective manner. With the nonlinear magneto-optical technique unveiling the magnetic symmetry information through the amplitude and phase of light, we could unambiguously resolve the polymorphic spin-flip transitions in CrSBr bilayers and tetralayers. Remarkably, the deterministic routing of polymorphic transitions originates from the breaking of energy degeneracy via a magnetic layer-sharing effect: the spin-flip transitions in a tetralayer are governed by the laterally extended bilayer, which acts as a control bit. We envision such controllable magnetic polymorphism to be ubiquitous for van der Waals layered antiferromagnets, and could lead to conceptually new design and construction of spintronic and opto-spintronic devices for probabilistic computation and neuromorphic engineering.
△ Less
Submitted 3 October, 2024;
originally announced October 2024.
-
Magnetostatic effect on spin dynamics properties in antiferromagnetic Van der Waals material CrSBr
Authors:
Hongyue Xu,
Nan Jiang,
Haoran Chen,
Yi Chen,
Tong Wu,
Yongwei Cui,
Yunzhuo Wu,
Zhiyuan Sheng,
Zeyuan Sun,
Jia Xu,
Qixi Mi,
Shiwei Wu,
Weichao Yu,
Yizheng Wu
Abstract:
Van der Waals (vdW) antiferromagnets are exceptional platforms for exploring the spin dynamics of antiferromagnetic materials owing to their weak interlayer exchange coupling. In this study, we examined the antiferromagnetic resonance spectra of anisotropic Van der Waals antiferromagnet CrSBr. In addition to the ordinary resonance modes, we observed a dipolar spin wave mode when the microwave fiel…
▽ More
Van der Waals (vdW) antiferromagnets are exceptional platforms for exploring the spin dynamics of antiferromagnetic materials owing to their weak interlayer exchange coupling. In this study, we examined the antiferromagnetic resonance spectra of anisotropic Van der Waals antiferromagnet CrSBr. In addition to the ordinary resonance modes, we observed a dipolar spin wave mode when the microwave field was oriented perpendicular to the in-plane easy axis of CrSBr. Furthermore, our results uncovered a pronounced dependency of various resonant modes on the orientation of the microwave field, which is pivotal for the accurate determination of exchange coupling constants. Numerical simulations have elucidated this orientation dependence of spin dynamics arises from the magnetostatic effect. This discovery underscores the previously underappreciated significance of dipolar interactions in shaping the dynamical properties of two-dimensional AFM materials, thereby enhancing our understanding of the intrinsic dynamic properties of vdW magnets.
△ Less
Submitted 19 September, 2024;
originally announced September 2024.
-
Sphaleron and gravitational wave with the Higgs-Dilaton potential in the Standard Model Two-Time Physics
Authors:
Vo Quoc Phong,
Quach Ai Mi,
Nguyen Xuan Vinh
Abstract:
By introducing a Higgs-Dilaton potential, the 2T model has a trigger for a first order electroweak phase transition, namely for the mass of Dilaton between $300 $ GeV and $550$ GeV. We have also compared the transition strengths in the case with and without daisy loops, the difference being always less than $0.2$. The effective Higgs potential has given a sphaleron energy less than $8.4$ TeV. The…
▽ More
By introducing a Higgs-Dilaton potential, the 2T model has a trigger for a first order electroweak phase transition, namely for the mass of Dilaton between $300 $ GeV and $550$ GeV. We have also compared the transition strengths in the case with and without daisy loops, the difference being always less than $0.2$. The effective Higgs potential has given a sphaleron energy less than $8.4$ TeV. The timescale of phase transition $(β/H^*)$ is larger than $25$ and less than $34$ in all cases that are sufficient to trigger the first order electroweak phase transition. Gravitational wave energy density caused by this transition, may be detected by future detectors, could indirectly confirm Dilaton.
△ Less
Submitted 14 May, 2025; v1 submitted 3 September, 2024;
originally announced September 2024.
-
Room-Temperature Multiferroic Skyrmions in LiNbO3 with enhancement in electric-optical property
Authors:
Yalong Yu,
Bo Xiong,
Siqi Wu,
Yekai Ren,
Nuo Chen,
Qingjiao Mi,
Zhaojie Zheng,
Kangping Lou,
Rui Wang,
Tao Chu
Abstract:
LiNbO3 (LN) is renowned for its exceptional ferroelectric properties, particularly its notable linear electro-optical (EO) effect, which is highly advantageous for various applications such as high-speed communication, optical computation, and quantum information processing. Compared to its ferroelectric properties, the magnetism of LN is not attractive enough due to its weak ferromagnetic nature.…
▽ More
LiNbO3 (LN) is renowned for its exceptional ferroelectric properties, particularly its notable linear electro-optical (EO) effect, which is highly advantageous for various applications such as high-speed communication, optical computation, and quantum information processing. Compared to its ferroelectric properties, the magnetism of LN is not attractive enough due to its weak ferromagnetic nature. Theoretical studies suggest that LN may exhibit a novel magnetoelectric coupling via ferroelectrically-induced ferromagnetism. However, this mechanism has not yet been experimentally validated in any materials, presenting significant challenges for research. In this study, we provide the first experimental evidence supporting the mechanism of ferroelectrically-induced ferromagnetism in LN, including observations of the Dzyaloshinskii-Moriya interaction (DMI) and magnetoelectric coupling. Additionally, we have identified various multiferroic skyrmions, within which ferroelectric polarization signals are detectable. These signals can be influenced by the magnetic vortex structures, indicating a magnetoelectric coupling nature. Currently, they are the only multiferroic skyrmions that can keep stable at room temperature. Moreover, these magnetic textures significantly affect the ferroelectric properties, as demonstrated by an enhancement of the linear electro-optic effect of LN by over 200%. Given the novel magnetoelectric coupling mechanism, the potential of multiferroic skyrmions in spintronics and advanced data storage, and the extensive use of LN EO modulators, our research has significant implications for condensed matter physics, multiferroic materials, and optoelectronics.
△ Less
Submitted 19 August, 2024;
originally announced August 2024.
-
Stable room-temperature multiferroic skyrmions in lithium niobate with enhanced Pockels effect
Authors:
Yalong Yu,
Bo Xiong,
Siqi Wu,
Yekai Ren,
Nuo Chen,
Qingjiao Mi,
Kangping Lou,
Rui Wang,
Tao Chu
Abstract:
Lithium Niobate (LN) is a ferroelectric material with exceptional electrical characteristics, including high piezoelectricity, high Pockels effect, etc. These properties make it a promising platform for numerous fields such as high-speed communication, optical computation, and quantum information processing. Besides these, the introduction of magnetic structures to LN holds significant potential t…
▽ More
Lithium Niobate (LN) is a ferroelectric material with exceptional electrical characteristics, including high piezoelectricity, high Pockels effect, etc. These properties make it a promising platform for numerous fields such as high-speed communication, optical computation, and quantum information processing. Besides these, the introduction of magnetic structures to LN holds significant potential to achieve magnetoelectric coupling, which can be applied in magnetic memory and data-processing devices with high efficiency. Here, for the first time, we observe a special topological magnetic structure called magnetic skyrmion in LN (SK-LN) by the combination of magnetic field annealing and rapid annealing processes . Compared to the magnetic skyrmions reported in magnetic systems, SK-LN exhibit exceptionally high stability. Additionally, the center of the magnetic vortex exhibits spontaneous ferroelectric polarization, indicating its multiferroic characteristic. With the excitation of these multiferroic skyrmions, the modulation efficiency of the electro-optical (EO) modulator fabricated on thin film lithium niobate on insulator (LNOI) wafer was found to be enhanced from 1.98 V*cm to 0.63 V*cm. It is considered that the multiferroic skyrmions significantly enhance the Pockels coefficient of LN to 101 pm/V, nearly three times the result (32pm/V) reported previously.
△ Less
Submitted 7 July, 2024;
originally announced July 2024.
-
Mott insulating phase and coherent-incoherent crossover across magnetic phase transition in 2D antiferromagnetic CrSBr
Authors:
Fan Wu,
Xuefeng Zhang,
Yi Chen,
Ding Pei,
Mengwen Zhan,
Zicheng Tao,
Cheng Chen,
Shipeng Lu,
Jingzhi Chen,
Shujie Tang,
Xia Wang,
Yanfeng Guo,
Lexian Yang,
Yan Zhang,
Yulin Chen,
Qixi Mi,
Gang Li,
Zhongkai Liu
Abstract:
In two-dimensional van der Waals magnetic materials, the interplay between magnetism and electron correlation can give rise to new ground states and lead to novel transport and optical properties. A fundamental question in these materials is how the electron correlation manifests and interacts with the magnetic orders. In this study, we demonstrate that the recently discovered 2D antiferromagnetic…
▽ More
In two-dimensional van der Waals magnetic materials, the interplay between magnetism and electron correlation can give rise to new ground states and lead to novel transport and optical properties. A fundamental question in these materials is how the electron correlation manifests and interacts with the magnetic orders. In this study, we demonstrate that the recently discovered 2D antiferromagnetic material, CrSBr, is a Mott insulator, through the combined use of resonant and temperature-dependent angle-resolved photoemission spectroscopy techiniques, supplemented by dynamical mean-field theory analysis. Intriguingly, we found that as the system transitions from the antiferromagnetic to the paramagnetic phases, its Mott bands undergo a reconfiguration, and a coherent-incoherent crossover, driven by the dissolution of the magnetic order. Our findings reveal a distinctive evolution of band structure associated with magnetic phase transitions, shedding light on the investigation of intricate interplay between correlation and magnetic orders in strongly correlated van der Waals magnetic materials.
△ Less
Submitted 30 May, 2024;
originally announced May 2024.
-
Mean Field Correlated Imitation Learning
Authors:
Zhiyu Zhao,
Qirui Mi,
Ning Yang,
Xue Yan,
Haifeng Zhang,
Jun Wang,
Yaodong Yang
Abstract:
We investigate multi-agent imitation learning (IL) within the framework of mean field games (MFGs), considering the presence of time-varying correlated signals. Existing MFG IL algorithms assume demonstrations are sampled from Mean Field Nash Equilibria (MFNE), limiting their adaptability to real-world scenarios. For example, in the traffic network equilibrium influenced by public routing recommen…
▽ More
We investigate multi-agent imitation learning (IL) within the framework of mean field games (MFGs), considering the presence of time-varying correlated signals. Existing MFG IL algorithms assume demonstrations are sampled from Mean Field Nash Equilibria (MFNE), limiting their adaptability to real-world scenarios. For example, in the traffic network equilibrium influenced by public routing recommendations, recommendations introduce time-varying correlated signals into the game, not captured by MFNE and other existing correlated equilibrium concepts. To address this gap, we propose Adaptive Mean Field Correlated Equilibrium (AMFCE), a general equilibrium incorporating time-varying correlated signals. We establish the existence of AMFCE under mild conditions and prove that MFNE is a subclass of AMFCE. We further propose Correlated Mean Field Imitation Learning (CMFIL), a novel IL framework designed to recover the AMFCE, accompanied by a theoretical guarantee on the quality of the recovered policy. Experimental results, including a real-world traffic flow prediction problem, demonstrate the superiority of CMFIL over state-of-the-art IL baselines, highlighting the potential of CMFIL in understanding large population behavior under correlated signals.
△ Less
Submitted 2 October, 2024; v1 submitted 14 April, 2024;
originally announced April 2024.
-
Learning Macroeconomic Policies through Dynamic Stackelberg Mean-Field Games
Authors:
Qirui Mi,
Zhiyu Zhao,
Chengdong Ma,
Siyu Xia,
Yan Song,
Mengyue Yang,
Jun Wang,
Haifeng Zhang
Abstract:
Macroeconomic outcomes emerge from individuals' decisions, making it essential to model how agents interact with macro policy via consumption, investment, and labor choices. We formulate this as a dynamic Stackelberg game: the government (leader) sets policies, and agents (followers) respond by optimizing their behavior over time. Unlike static models, this dynamic formulation captures temporal de…
▽ More
Macroeconomic outcomes emerge from individuals' decisions, making it essential to model how agents interact with macro policy via consumption, investment, and labor choices. We formulate this as a dynamic Stackelberg game: the government (leader) sets policies, and agents (followers) respond by optimizing their behavior over time. Unlike static models, this dynamic formulation captures temporal dependencies and strategic feedback critical to policy design. However, as the number of agents increases, explicitly simulating all agent-agent and agent-government interactions becomes computationally infeasible. To address this, we propose the Dynamic Stackelberg Mean Field Game (DSMFG) framework, which approximates these complex interactions via agent-population and government-population couplings. This approximation preserves individual-level feedback while ensuring scalability, enabling DSMFG to jointly model three core features of real-world policymaking: dynamic feedback, asymmetry, and large scale. We further introduce Stackelberg Mean Field Reinforcement Learning (SMFRL), a data-driven algorithm that learns the leader's optimal policies while maintaining personalized responses for individual agents. Empirically, we validate our approach in a large-scale simulated economy, where it scales to 1,000 agents (vs. 100 in prior work) and achieves a fourfold increase in GDP over classical economic methods and a nineteenfold improvement over the static 2022 U.S. federal income tax policy.
△ Less
Submitted 1 June, 2025; v1 submitted 14 March, 2024;
originally announced March 2024.
-
Precise and Fast LIDAR via Electrical Asynchronous Sampling Based on a Single Femtosecond Laser
Authors:
Lizong Dong,
Qinggai Mi,
Siyu Zhou,
Yuetang Yang,
Yuanzu Wang,
Guanhao Wu
Abstract:
Using a laser-based ranging method for precise environmental 3D sensing, LiDAR has numerous applications in science and industry. However, conventional LiDAR face challenges in simultaneously achieving high ranging precision and fast measurement rates, which limits their applicability in more precise fields, such as aerospace, smart healthcare and beyond. By employing an asynchronous electrical pu…
▽ More
Using a laser-based ranging method for precise environmental 3D sensing, LiDAR has numerous applications in science and industry. However, conventional LiDAR face challenges in simultaneously achieving high ranging precision and fast measurement rates, which limits their applicability in more precise fields, such as aerospace, smart healthcare and beyond. By employing an asynchronous electrical pulse sampling strategy on a single optical frequency comb with a stable repetition rate and femtosecond-pulse width, we exploit the advantages of optical-frequency-comb ranging method and overcome the limitations of sampling aliasing and low data-utilization inherent in traditional approaches. This enables a significant improvement of LiDAR's performance to achieve micrometer-level precision and megahertz-regimes update rates over meter-range on non-cooperative targets. Specifically, we achieve 38.8-$μ$m Allan deviation at 1-MHz update rate and 8.06-$μ$m Allan deviation after 2-ms time-averaging based on a 56.091-MHz femtosecond laser. This enhancement enables various advanced measurement applications, including metrology monitoring on high-speed objects, 1-megapixel/s precise 3D scanning imaging and first-ever contactless vital sign detection using time-of-flight LiDAR. This LiDAR unlock new possibilities for precise and fast real-time measurements in diverse fields.
△ Less
Submitted 7 December, 2024; v1 submitted 13 February, 2024;
originally announced February 2024.
-
Large Language Models Play StarCraft II: Benchmarks and A Chain of Summarization Approach
Authors:
Weiyu Ma,
Qirui Mi,
Yongcheng Zeng,
Xue Yan,
Yuqiao Wu,
Runji Lin,
Haifeng Zhang,
Jun Wang
Abstract:
StarCraft II is a challenging benchmark for AI agents due to the necessity of both precise micro level operations and strategic macro awareness. Previous works, such as Alphastar and SCC, achieve impressive performance on tackling StarCraft II , however, still exhibit deficiencies in long term strategic planning and strategy interpretability. Emerging large language model (LLM) agents, such as Voy…
▽ More
StarCraft II is a challenging benchmark for AI agents due to the necessity of both precise micro level operations and strategic macro awareness. Previous works, such as Alphastar and SCC, achieve impressive performance on tackling StarCraft II , however, still exhibit deficiencies in long term strategic planning and strategy interpretability. Emerging large language model (LLM) agents, such as Voyage and MetaGPT, presents the immense potential in solving intricate tasks. Motivated by this, we aim to validate the capabilities of LLMs on StarCraft II, a highly complex RTS game.To conveniently take full advantage of LLMs` reasoning abilities, we first develop textual StratCraft II environment, called TextStarCraft II, which LLM agent can interact. Secondly, we propose a Chain of Summarization method, including single frame summarization for processing raw observations and multi frame summarization for analyzing game information, providing command recommendations, and generating strategic decisions. Our experiment consists of two parts: first, an evaluation by human experts, which includes assessing the LLMs`s mastery of StarCraft II knowledge and the performance of LLM agents in the game; second, the in game performance of LLM agents, encompassing aspects like win rate and the impact of Chain of Summarization.Experiment results demonstrate that: 1. LLMs possess the relevant knowledge and complex planning abilities needed to address StarCraft II scenarios; 2. Human experts consider the performance of LLM agents to be close to that of an average player who has played StarCraft II for eight years; 3. LLM agents are capable of defeating the built in AI at the Harder(Lv5) difficulty level. We have open sourced the code and released demo videos of LLM agent playing StarCraft II.
△ Less
Submitted 17 June, 2024; v1 submitted 19 December, 2023;
originally announced December 2023.
-
TaxAI: A Dynamic Economic Simulator and Benchmark for Multi-Agent Reinforcement Learning
Authors:
Qirui Mi,
Siyu Xia,
Yan Song,
Haifeng Zhang,
Shenghao Zhu,
Jun Wang
Abstract:
Taxation and government spending are crucial tools for governments to promote economic growth and maintain social equity. However, the difficulty in accurately predicting the dynamic strategies of diverse self-interested households presents a challenge for governments to implement effective tax policies. Given its proficiency in modeling other agents in partially observable environments and adapti…
▽ More
Taxation and government spending are crucial tools for governments to promote economic growth and maintain social equity. However, the difficulty in accurately predicting the dynamic strategies of diverse self-interested households presents a challenge for governments to implement effective tax policies. Given its proficiency in modeling other agents in partially observable environments and adaptively learning to find optimal policies, Multi-Agent Reinforcement Learning (MARL) is highly suitable for solving dynamic games between the government and numerous households. Although MARL shows more potential than traditional methods such as the genetic algorithm and dynamic programming, there is a lack of large-scale multi-agent reinforcement learning economic simulators. Therefore, we propose a MARL environment, named \textbf{TaxAI}, for dynamic games involving $N$ households, government, firms, and financial intermediaries based on the Bewley-Aiyagari economic model. Our study benchmarks 2 traditional economic methods with 7 MARL methods on TaxAI, demonstrating the effectiveness and superiority of MARL algorithms. Moreover, TaxAI's scalability in simulating dynamic interactions between the government and 10,000 households, coupled with real-data calibration, grants it a substantial improvement in scale and reality over existing simulators. Therefore, TaxAI is the most realistic economic simulator for optimal tax policy, which aims to generate feasible recommendations for governments and individuals.
△ Less
Submitted 14 March, 2024; v1 submitted 28 September, 2023;
originally announced September 2023.
-
Joint Caching and Transmission in the Mobile Edge Network: A Multi-Agent Learning Approach
Authors:
Qirui Mi,
Ning Yang,
Haifeng Zhang,
Haijun Zhang,
Jun Wang
Abstract:
Joint caching and transmission optimization problem is challenging due to the deep coupling between decisions. This paper proposes an iterative distributed multi-agent learning approach to jointly optimize caching and transmission. The goal of this approach is to minimize the total transmission delay of all users. In this iterative approach, each iteration includes caching optimization and transmi…
▽ More
Joint caching and transmission optimization problem is challenging due to the deep coupling between decisions. This paper proposes an iterative distributed multi-agent learning approach to jointly optimize caching and transmission. The goal of this approach is to minimize the total transmission delay of all users. In this iterative approach, each iteration includes caching optimization and transmission optimization. A multi-agent reinforcement learning (MARL)-based caching network is developed to cache popular tasks, such as answering which files to evict from the cache and which files to storage. Based on the cached files of the caching network, the transmission network transmits cached files for users by single transmission (ST) or joint transmission (JT) with multi-agent Bayesian learning automaton (MABLA) method. And then users access the edge servers with the minimum transmission delay. The experimental results demonstrate the performance of the proposed multi-agent learning approach.
△ Less
Submitted 9 September, 2022;
originally announced September 2022.
-
Observation of non-trivial topological electronic structure of orthorhombic SnSe
Authors:
H. J. Zheng,
W. J. Shi,
C. W. Wang,
Y. Y. Lv,
W. Xia,
B. H. Li,
F. Wu,
S. M. He,
K. Huang,
S. T. Cui,
C. Chen,
H. F. Yang,
A. J. Liang,
M. X. Wang,
Z. Sun,
S. H. Yao,
Y. B. Chen,
Y. F. Guo,
Q. X. Mi,
L. X. Yang,
M. S. Bahramy,
Z. K. Liu,
Y. L. Chen
Abstract:
Topological electronic structures are key to the topological classification of quantum materials and play an important role in their physical properties and applications. Recently, SnSe has attracted great research interests due to its superior thermoelectric performance. However, it's topological nature has long been ignored. In this work, by combining synchrotron-based angle-resolved photoemissi…
▽ More
Topological electronic structures are key to the topological classification of quantum materials and play an important role in their physical properties and applications. Recently, SnSe has attracted great research interests due to its superior thermoelectric performance. However, it's topological nature has long been ignored. In this work, by combining synchrotron-based angle-resolved photoemission spectroscopy and ab-initio calculations, we systematically investigated the topological electronic structure of orthorhombic SnSe. By identifying the continuous gap in the valence bands due to the band inversion and the topological surface states on its (001) surface, we establish SnSe as a strong topological insulator. Furthermore, we studied the evolution of the topological electronic structure and propose the topological phase diagram in SnSe1-xTex. Our work reveals the topological non-trivial nature of SnSe and provides new understandings of its intriguing transport properties.
△ Less
Submitted 14 April, 2022;
originally announced April 2022.
-
Photoemission Study of the Electronic Structure of Valence Band Convergent SnSe
Authors:
C. W. Wang,
Y. Y. Y. Xia,
Z. Tian,
J. Jiang,
B. H. Li,
S. T. Cui,
H. F. Yang,
A. J. Liang,
X. Y. Zhan,
G. H. Hong,
S. Liu,
C. Chen,
M. X. Wang,
L. X. Yang,
Z. Liu,
Q. X. Mi,
G. Li,
J. M. Xue,
Z. K. Liu,
Y. L. Chen
Abstract:
IV-VI semiconductor SnSe has been known as the material with record high thermoelectric performance.The multiple close-to-degenerate valence bands in the electronic band structure has been one of the key factors contributing to the high power factor and thus figure of merit in the SnSe single crystal. To date, there have been primarily theoretical calculations of this particular electronic band st…
▽ More
IV-VI semiconductor SnSe has been known as the material with record high thermoelectric performance.The multiple close-to-degenerate valence bands in the electronic band structure has been one of the key factors contributing to the high power factor and thus figure of merit in the SnSe single crystal. To date, there have been primarily theoretical calculations of this particular electronic band structure. In this paper, however, using angle-resolved photoemission spectroscopy, we perform a systematic investigation of the electronic structure of SnSe. We directly observe three predicted hole bands with small energy differences between their band tops and relatively small in-plane effective masses, in good agreement with the ab initio calculations and critical for the enhancement of the Seebeck coefficient while keeping high electrical conductivity. Our results reveal the complete band structure of SnSe and help to provide a deeper understanding of the electronic origin of the excellent thermoelectric performances in SnSe.
△ Less
Submitted 12 April, 2018;
originally announced April 2018.
-
Field-effect transistors of high-mobility few-layer SnSe$_{2}$
Authors:
Chenglei Guo,
Zhen Tian,
Yanjun Xiao,
Qixi Mi,
Jiamin Xue
Abstract:
We report the transport properties of mechanically exfoliated few-layer SnSe$_{2}$ flakes, whose mobility is found with four probe measurements to be ~ 85 cm$^{2}$V$^{-1}$s$^{-1}$ at 300 K, higher than those of the majority of few-layer transitional metal dichalcogenides (TMDs). The mobility increases strongly with decreased temperature, indicating a phonon limited transport. The conductivity of t…
▽ More
We report the transport properties of mechanically exfoliated few-layer SnSe$_{2}$ flakes, whose mobility is found with four probe measurements to be ~ 85 cm$^{2}$V$^{-1}$s$^{-1}$ at 300 K, higher than those of the majority of few-layer transitional metal dichalcogenides (TMDs). The mobility increases strongly with decreased temperature, indicating a phonon limited transport. The conductivity of the semiconducting SnSe$_{2}$ shows a metallic behavior, which is explained by two competing factors involving the different temperature dependence of mobility and carrier density. The Fermi level is found to be 87 meV below the conduction band minima (CBM) at 300 K and 12 meV below the CBM at 78 K, resulting from a heavy n-type doping. Previous studies have found SnSe$_{2}$ field-effect transistors (FETs) to be very difficult to turn off. We find the limiting factor to be the flake thickness compared with the maximum depletion width. With fully depleted devices, we are able to achieve a current on-off ratio of ~10$^{5}$. These results demonstrate the great potential of SnSe2 as a two dimensional (2D) semiconducting material and are helpful for our understanding of other heavily doped 2D materials.
△ Less
Submitted 13 September, 2016;
originally announced September 2016.
