CayleyPy RL: Pathfinding and Reinforcement Learning on Cayley Graphs
Authors:
A. Chervov,
A. Soibelman,
S. Lytkin,
I. Kiselev,
S. Fironov,
A. Lukyanenko,
A. Dolgorukova,
A. Ogurtsov,
F. Petrov,
S. Krymskii,
M. Evseev,
L. Grunvald,
D. Gorodkov,
G. Antiufeev,
G. Verbii,
V. Zamkovoy,
L. Cheldieva,
I. Koltsov,
A. Sychev,
M. Obozov,
A. Eliseev,
S. Nikolenko,
N. Narynbaev,
R. Turtayev,
N. Rokotyan
, et al. (9 additional authors not shown)
Abstract:
This paper is the second in a series of studies on developing efficient artificial intelligence-based approaches to pathfinding on extremely large graphs (e.g. $10^{70}$ nodes) with a focus on Cayley graphs and mathematical applications. The open-source CayleyPy project is a central component of our research. The present paper proposes a novel combination of a reinforcement learning approach with…
▽ More
This paper is the second in a series of studies on developing efficient artificial intelligence-based approaches to pathfinding on extremely large graphs (e.g. $10^{70}$ nodes) with a focus on Cayley graphs and mathematical applications. The open-source CayleyPy project is a central component of our research. The present paper proposes a novel combination of a reinforcement learning approach with a more direct diffusion distance approach from the first paper. Our analysis includes benchmarking various choices for the key building blocks of the approach: architectures of the neural network, generators for the random walks and beam search pathfinding. We compared these methods against the classical computer algebra system GAP, demonstrating that they "overcome the GAP" for the considered examples. As a particular mathematical application we examine the Cayley graph of the symmetric group with cyclic shift and transposition generators. We provide strong support for the OEIS-A186783 conjecture that the diameter is equal to n(n-1)/2 by machine learning and mathematical methods. We identify the conjectured longest element and generate its decomposition of the desired length. We prove a diameter lower bound of n(n-1)/2-n/2 and an upper bound of n(n-1)/2+ 3n by presenting the algorithm with given complexity. We also present several conjectures motivated by numerical experiments, including observations on the central limit phenomenon (with growth approximated by a Gumbel distribution), the uniform distribution for the spectrum of the graph, and a numerical study of sorting networks. To stimulate crowdsourcing activity, we create challenges on the Kaggle platform and invite contributions to improve and benchmark approaches on Cayley graph pathfinding and other tasks.
△ Less
Submitted 25 February, 2025;
originally announced February 2025.
A Machine Learning Approach That Beats Large Rubik's Cubes
Authors:
Alexander Chervov,
Kirill Khoruzhii,
Nikita Bukhal,
Jalal Naghiyev,
Vladislav Zamkovoy,
Ivan Koltsov,
Lyudmila Cheldieva,
Arsenii Sychev,
Arsenii Lenin,
Mark Obozov,
Egor Urvanov,
Alexey Romanov
Abstract:
The paper proposes a novel machine learning-based approach to the pathfinding problem on extremely large graphs. This method leverages diffusion distance estimation via a neural network and uses beam search for pathfinding. We demonstrate its efficiency by finding solutions for 4x4x4 and 5x5x5 Rubik's cubes with unprecedentedly short solution lengths, outperforming all available solvers and introd…
▽ More
The paper proposes a novel machine learning-based approach to the pathfinding problem on extremely large graphs. This method leverages diffusion distance estimation via a neural network and uses beam search for pathfinding. We demonstrate its efficiency by finding solutions for 4x4x4 and 5x5x5 Rubik's cubes with unprecedentedly short solution lengths, outperforming all available solvers and introducing the first machine learning solver beyond the 3x3x3 case. In particular, it surpasses every single case of the combined best results in the Kaggle Santa 2023 challenge, which involved over 1,000 teams. For the 3x3x3 Rubik's cube, our approach achieves an optimality rate exceeding 98%, matching the performance of task-specific solvers and significantly outperforming prior solutions such as DeepCubeA (60.3%) and EfficientCube (69.6%). Additionally, our solution is more than 26 times faster in solving 3x3x3 Rubik's cubes while requiring up to 18.5 times less model training time than the most efficient state-of-the-art competitor.
△ Less
Submitted 18 February, 2025;
originally announced February 2025.
