Learning Exploration Strategies to Solve Real-World Marble Runs
Authors:
Alisa Allaire,
Christopher G. Atkeson
Abstract:
Tasks involving locally unstable or discontinuous dynamics (such as bifurcations and collisions) remain challenging in robotics, because small variations in the environment can have a significant impact on task outcomes. For such tasks, learning a robust deterministic policy is difficult. We focus on structuring exploration with multiple stochastic policies based on a mixture of experts (MoE) poli…
▽ More
Tasks involving locally unstable or discontinuous dynamics (such as bifurcations and collisions) remain challenging in robotics, because small variations in the environment can have a significant impact on task outcomes. For such tasks, learning a robust deterministic policy is difficult. We focus on structuring exploration with multiple stochastic policies based on a mixture of experts (MoE) policy representation that can be efficiently adapted. The MoE policy is composed of stochastic sub-policies that allow exploration of multiple distinct regions of the action space (or strategies) and a high-level selection policy to guide exploration towards the most promising regions. We develop a robot system to evaluate our approach in a real-world physical problem solving domain. After training the MoE policy in simulation, online learning in the real world demonstrates efficient adaptation within just a few dozen attempts, with a minimal sim2real gap. Our results confirm that representing multiple strategies promotes efficient adaptation in new environments and strategies learned under different dynamics can still provide useful information about where to look for good strategies.
△ Less
Submitted 8 March, 2023;
originally announced March 2023.
Thermal Hall conductivity in the cuprate Mott insulators Nd$_2$CuO$_4$ and Sr$_2$CuO$_2$Cl$_2$
Authors:
Marie-Eve Boulanger,
Gaël Grissonnanche,
Sven Badoux,
Andréanne Allaire,
Étienne Lefrançois,
Anaëlle Legros,
Adrien Gourgout,
Maxime Dion,
C. H. Wang,
X. H. Chen,
R. Liang,
W. N. Hardy,
D. A Bonn,
Louis Taillefer
Abstract:
The heat carriers responsible for the unexpectedly large thermal Hall conductivity of the cuprate Mott insulator La$_2$CuO$_4$ were recently shown to be phonons. However, the mechanism by which phonons in cuprates acquire chirality in a magnetic field is still unknown. Here, we report a similar thermal Hall conductivity in two cuprate Mott insulators with significantly different crystal structures…
▽ More
The heat carriers responsible for the unexpectedly large thermal Hall conductivity of the cuprate Mott insulator La$_2$CuO$_4$ were recently shown to be phonons. However, the mechanism by which phonons in cuprates acquire chirality in a magnetic field is still unknown. Here, we report a similar thermal Hall conductivity in two cuprate Mott insulators with significantly different crystal structures and magnetic orders - Nd$_2$CuO$_4$ and Sr$_2$CuO$_2$Cl$_2$ - and show that two potential mechanisms can be excluded - the scattering of phonons by rare-earth impurities and by structural domains. Our comparative study further reveals that orthorhombicity, apical oxygens, the tilting of oxygen octahedra and the canting of spins out of the CuO$_2$ planes are not essential to the mechanism of chirality. Our findings point to a chiral mechanism coming from a coupling of acoustic phonons to the intrinsic excitations of the CuO$_2$ planes.
△ Less
Submitted 9 July, 2020;
originally announced July 2020.
