Deep Symbolic Optimization: Reinforcement Learning for Symbolic Mathematics
Authors:
Conor F. Hayes,
Felipe Leno Da Silva,
Jiachen Yang,
T. Nathan Mundhenk,
Chak Shing Lee,
Jacob F. Pettit,
Claudio Santiago,
Sookyung Kim,
Joanne T. Kim,
Ignacio Aravena Solis,
Ruben Glatt,
Andre R. Goncalves,
Alexander Ladd,
Ahmet Can Solak,
Thomas Desautels,
Daniel Faissol,
Brenden K. Petersen,
Mikel Landajuela
Abstract:
Deep Symbolic Optimization (DSO) is a novel computational framework that enables symbolic optimization for scientific discovery, particularly in applications involving the search for intricate symbolic structures. One notable example is equation discovery, which aims to automatically derive mathematical models expressed in symbolic form. In DSO, the discovery process is formulated as a sequential…
▽ More
Deep Symbolic Optimization (DSO) is a novel computational framework that enables symbolic optimization for scientific discovery, particularly in applications involving the search for intricate symbolic structures. One notable example is equation discovery, which aims to automatically derive mathematical models expressed in symbolic form. In DSO, the discovery process is formulated as a sequential decision-making task. A generative neural network learns a probabilistic model over a vast space of candidate symbolic expressions, while reinforcement learning strategies guide the search toward the most promising regions. This approach integrates gradient-based optimization with evolutionary and local search techniques, and it incorporates in-situ constraints, domain-specific priors, and advanced policy optimization methods. The result is a robust framework capable of efficiently exploring extensive search spaces to identify interpretable and physically meaningful models. Extensive evaluations on benchmark problems have demonstrated that DSO achieves state-of-the-art performance in both accuracy and interpretability. In this chapter, we provide a comprehensive overview of the DSO framework and illustrate its transformative potential for automating symbolic optimization in scientific discovery.
△ Less
Submitted 15 May, 2025;
originally announced May 2025.
Image Deconvolution via Noise-Tolerant Self-Supervised Inversion
Authors:
Hirofumi Kobayashi,
Ahmet Can Solak,
Joshua Batson,
Loic A. Royer
Abstract:
We propose a general framework for solving inverse problems in the presence of noise that requires no signal prior, no noise estimate, and no clean training data. We only require that the forward model be available and that the noise be statistically independent across measurement dimensions. We build upon the theory of $\mathcal{J}$-invariant functions (Batson & Royer 2019, arXiv:1901.11365) and…
▽ More
We propose a general framework for solving inverse problems in the presence of noise that requires no signal prior, no noise estimate, and no clean training data. We only require that the forward model be available and that the noise be statistically independent across measurement dimensions. We build upon the theory of $\mathcal{J}$-invariant functions (Batson & Royer 2019, arXiv:1901.11365) and show how self-supervised denoising \emph{à la} Noise2Self is a special case of learning a noise-tolerant pseudo-inverse of the identity. We demonstrate our approach by showing how a convolutional neural network can be taught in a self-supervised manner to deconvolve images and surpass in image quality classical inversion schemes such as Lucy-Richardson deconvolution.
△ Less
Submitted 10 June, 2020;
originally announced June 2020.
