Reinforcement Learning for Adaptive Mesh Refinement
Authors:
Jiachen Yang,
Tarik Dzanic,
Brenden Petersen,
Jun Kudo,
Ketan Mittal,
Vladimir Tomov,
Jean-Sylvain Camier,
Tuo Zhao,
Hongyuan Zha,
Tzanio Kolev,
Robert Anderson,
Daniel Faissol
Abstract:
Large-scale finite element simulations of complex physical systems governed by partial differential equations (PDE) crucially depend on adaptive mesh refinement (AMR) to allocate computational budget to regions where higher resolution is required. Existing scalable AMR methods make heuristic refinement decisions based on instantaneous error estimation and thus do not aim for long-term optimality o…
▽ More
Large-scale finite element simulations of complex physical systems governed by partial differential equations (PDE) crucially depend on adaptive mesh refinement (AMR) to allocate computational budget to regions where higher resolution is required. Existing scalable AMR methods make heuristic refinement decisions based on instantaneous error estimation and thus do not aim for long-term optimality over an entire simulation. We propose a novel formulation of AMR as a Markov decision process and apply deep reinforcement learning (RL) to train refinement policies directly from simulation. AMR poses a new problem for RL as both the state dimension and available action set changes at every step, which we solve by proposing new policy architectures with differing generality and inductive bias. The model sizes of these policy architectures are independent of the mesh size and hence can be deployed on larger simulations than those used at train time. We demonstrate in comprehensive experiments on static function estimation and time-dependent equations that RL policies can be trained on problems without using ground truth solutions, are competitive with a widely-used error estimator, and generalize to larger, more complex, and unseen test problems.
△ Less
Submitted 21 February, 2023; v1 submitted 1 March, 2021;
originally announced March 2021.
Chains of distributions, hierarchical Bayesian models and Benford's Law
Authors:
Dennis Jang,
Jung Uk Kang,
Alex Kruckman,
Jun Kudo,
Steven J. Miller
Abstract:
Kossovsky recently conjectured that the distribution of leading digits of a chain of probability distributions converges to Benford's law as the length of the chain grows. We prove his conjecture in many cases, and provide an interpretation in terms of products of independent random variables and a central limit theorem. An interesting consequence is that in hierarchical Bayesian models priors t…
▽ More
Kossovsky recently conjectured that the distribution of leading digits of a chain of probability distributions converges to Benford's law as the length of the chain grows. We prove his conjecture in many cases, and provide an interpretation in terms of products of independent random variables and a central limit theorem. An interesting consequence is that in hierarchical Bayesian models priors tend to satisfy Benford's Law as the number of levels of the hierarchy increases, which allows us to develop some simple tests (based on Benford's law) to test proposed models. We give explicit formulas for the error terms as sums of Mellin transforms, which converges extremely rapidly as the number of terms in the chain grows. We may interpret our results as showing that certain Markov chain Monte Carlo processes are rapidly mixing to Benford's law.
△ Less
Submitted 15 June, 2008; v1 submitted 27 May, 2008;
originally announced May 2008.
