A Teacher-Student MPC-PPO Coupled Reinforcement Learning Framework for Winter Temperature Control of Solar Greenhouses in Northern China
Authors:
Jingxin Yu,
Lushun Ma,
Jinpeng Zhao,
Jianchao Ci,
Muhammad Abdul Munnaf,
Eldert van Henten,
Peter Groot Koerkamp,
Shuyi Peng,
Xiaoming Wei,
Congcong Sun
Abstract:
Solar greenhouses are crucial infrastructure of modern agricultural production in northern China. However, highly fluctuating temperature in winter season results in poor greenhouse temperature control, which affects crop growth and increases energy consumption. To tackle these challenges, an advanced control system that can efficiently optimize multiple objectives under dramatic climate condition…
▽ More
Solar greenhouses are crucial infrastructure of modern agricultural production in northern China. However, highly fluctuating temperature in winter season results in poor greenhouse temperature control, which affects crop growth and increases energy consumption. To tackle these challenges, an advanced control system that can efficiently optimize multiple objectives under dramatic climate conditions is essential. Therefore, this study propose a model predictive control-coupled proximal policy optimization (MPC-PPO) control framework. A teacher-student control framework is constructed in which the MPC generating high-quality control experiences to guide the PPO agent's learning process. An adaptive dynamic weighting mechanism is employed to balance the influence of MPC experiences during PPO training. Evaluation conducted in solar greenhouses across three provinces in northern China (Beijing, Hebei, and Shandong) demonstrates that: (1) the MPC-PPO method achieved the highest temperature control performance (96.31 on a 100-point scale), with a 5.46-point improvement compared to the non-experience integration baseline, when reduced standard deviation by nearly half and enhanced exploration efficiency; (2) the MPC-PPO method achieved a ventilation control reward of 99.19, optimizing ventilation window operations with intelligent time-differentiated strategies that reduced energy loss during non-optimal hours; (3) feature analysis reveals that historical window opening, air temperature, and historical temperature are the most influential features for effective control, i.e., SHAP values of 7.449, 4.905, and 4.747 respectively; and (4) cross-regional tests indicated that MPC-PPO performs best in all test regions, confirming generalization of the method.
△ Less
Submitted 1 July, 2025; v1 submitted 29 April, 2025;
originally announced April 2025.
