-
Lessons learned from field demonstrations of model predictive control and reinforcement learning for residential and commercial HVAC: A review
Authors:
Arash J. Khabbazi,
Elias N. Pergantis,
Levi D. Reyes Premer,
Panagiotis Papageorgiou,
Alex H. Lee,
James E. Braun,
Gregor P. Henze,
Kevin J. Kircher
Abstract:
A large body of simulation research suggests that model predictive control (MPC) and reinforcement learning (RL) for heating, ventilation, and air-conditioning (HVAC) in residential and commercial buildings could reduce energy costs, pollutant emissions, and strain on power grids. Despite this potential, neither MPC nor RL has seen widespread industry adoption. Field demonstrations could accelerat…
▽ More
A large body of simulation research suggests that model predictive control (MPC) and reinforcement learning (RL) for heating, ventilation, and air-conditioning (HVAC) in residential and commercial buildings could reduce energy costs, pollutant emissions, and strain on power grids. Despite this potential, neither MPC nor RL has seen widespread industry adoption. Field demonstrations could accelerate MPC and RL adoption by providing real-world data that support the business case for deployment. Here we review 24 papers that document field demonstrations of MPC and RL in residential buildings and 80 in commercial buildings. After presenting demographic information -- such as experiment scopes, locations, and durations -- this paper analyzes experiment protocols and their influence on performance estimates. We find that 71% of the reviewed field demonstrations use experiment protocols that may lead to unreliable performance estimates. Over the remaining 29% that we view as reliable, the weighted-average cost savings, weighted by experiment duration, are 16% in residential buildings and 13% in commercial buildings. While these savings are potentially attractive, making the business case for MPC and RL also requires characterizing the costs of deployment, operation, and maintenance. Only 13 of the 104 reviewed papers report these costs or discuss related challenges. Based on these observations, we recommend directions for future field research, including: Improving experiment protocols; reporting deployment, operation, and maintenance costs; designing algorithms and instrumentation to reduce these costs; controlling HVAC equipment alongside other distributed energy resources; and pursuing emerging objectives such as peak shaving, arbitraging wholesale energy prices, and providing power grid reliability services.
△ Less
Submitted 12 June, 2025; v1 submitted 6 March, 2025;
originally announced March 2025.
-
Protecting residential electrical panels and service through model predictive control: A field study
Authors:
Elias N. Pergantis,
Levi D. Reyes Premer,
Alex H. Lee,
Priyadarshan,
Haotian Liu,
Eckhard A. Groll,
Davide Ziviani,
Kevin J. Kircher
Abstract:
Residential electrification - replacing fossil-fueled appliances and vehicles with electric machines - can significantly reduce greenhouse gas emissions and air pollution. However, installing electric appliances or vehicle charging in a residential building can sharply increase its current draws. In older housing, high current draws can jeopardize electrical infrastructure, such as circuit breaker…
▽ More
Residential electrification - replacing fossil-fueled appliances and vehicles with electric machines - can significantly reduce greenhouse gas emissions and air pollution. However, installing electric appliances or vehicle charging in a residential building can sharply increase its current draws. In older housing, high current draws can jeopardize electrical infrastructure, such as circuit breaker panels or electrical service (the wires that connect a building to the distribution grid). Upgrading electrical infrastructure can entail long delays and high costs, so poses a significant barrier to electrification. This paper develops and field-tests a control system that avoids the need for electrical upgrades by keeping an electrified home's total current draw within the safe limits of its panel and service. In the proposed control architecture, a high-level controller plans device set-points over a rolling prediction horizon. A low-level controller monitors real-time conditions and ramps down devices if necessary. The control system was tested in an occupied, electrified single-family house with code-minimum insulation, an air-to-air heat pump and backup resistance heat, a resistance water heater, and a plug-in hybrid electric vehicle with Level I charging. The field tests spanned 31 winter days with outdoor temperatures as low as -20 C. The control system maintained the whole-home current within the safe limits of electrical panels and service rated at 100 A, a common rating for older houses in North America, by adjusting only the temperature set-points of the heat pump and water heater. Simulations suggest that the same 100 A limit could accommodate a second electric vehicle with Level II charging. The proposed control system could allow older homes to safely electrify without upgrading electrical panels or service, saving a typical household on the order of $2,000 to $10,000.
△ Less
Submitted 5 February, 2025; v1 submitted 7 September, 2024;
originally announced September 2024.
-
Humidity-Aware Model Predictive Control for Residential Air Conditioning: A Field Study
Authors:
Elias N. Pergantis,
Parveen Dhillon,
Levi D. Reyes Premer,
Alex H. Lee,
Davide Ziviani,
Kevin J. Kircher
Abstract:
Model predictive control of residential air conditioning could reduce energy costs and greenhouse gas emissions while maintaining or improving occupants' thermal comfort. However, most approaches to predictive air conditioning control either do not model indoor humidity or treat it as constant. This simplification stems from challenges with modeling indoor humidity dynamics, particularly the high-…
▽ More
Model predictive control of residential air conditioning could reduce energy costs and greenhouse gas emissions while maintaining or improving occupants' thermal comfort. However, most approaches to predictive air conditioning control either do not model indoor humidity or treat it as constant. This simplification stems from challenges with modeling indoor humidity dynamics, particularly the high-order, nonlinear equations that govern heat and mass transfer between the air conditioner's evaporator coil and the indoor air. This paper develops a machine-learning approach to modeling indoor humidity dynamics that is suitable for real-world deployment at scale. This study then investigates the value of humidity modeling in four field tests of predictive control in an occupied house. The four field tests evaluate two different building models: One with constant humidity and one with time-varying humidity. Each modeling approach is tested in two different predictive controllers: One that focuses on reducing energy costs and one that focuses on constraining electric power below a utility-specified threshold. The two models lead to similar performance for reducing energy costs. Combining the results of this study and a prior heating study of the same house, the estimated year-round energy cost savings were $340-497 or 22-31% (95% confidence intervals); these savings were consistent across both humidity models. However, in the demand response tests, the simplifying assumption of constant humidity led to far more frequent and severe violations of the power constraint. These results suggest that accurate building models are important for nonlinear objectives, such as reducing or constraining peak demand, while for linear objectives such as reducing energy costs or emissions, model accuracy is less important.
△ Less
Submitted 15 September, 2024; v1 submitted 1 July, 2024;
originally announced July 2024.
-
Field demonstration of predictive heating control for an all-electric house in a cold climate
Authors:
Elias N. Pergantis,
Priyadarshan,
Nadah Al Theeb,
Parveen Dhillon,
Jonathan P. Ore,
Davide Ziviani,
Eckhard A. Groll,
Kevin J. Kircher
Abstract:
Efficient electric heat pumps that replace fossil-fueled heating systems could significantly reduce greenhouse gas emissions. However, electric heat pumps can sharply increase electricity demand, causing high utility bills and stressing the power grid. Residential neighborhoods could see particularly high electricity demand during cold weather, when heat demand rises and heat pump efficiencies fal…
▽ More
Efficient electric heat pumps that replace fossil-fueled heating systems could significantly reduce greenhouse gas emissions. However, electric heat pumps can sharply increase electricity demand, causing high utility bills and stressing the power grid. Residential neighborhoods could see particularly high electricity demand during cold weather, when heat demand rises and heat pump efficiencies fall. This paper presents the development and field demonstration of a predictive control system for an air-to-air heat pump with backup electric resistance heat. The control system adjusts indoor temperature set-points based on weather forecasts, occupancy conditions, and data-driven models of the building and heating equipment. Field tests from January to March of 2023 in an occupied, all-electric, 208 m^2 detached single-family house in Indiana, USA, included outdoor temperatures as low as -15 C. On average over these tests, the control system reduced daily heating energy use by 19% (95% confidence interval: 13--24%), energy used for backup heat by 38%, and the frequency of using the highest stage (19 kW) of backup heat by 83%. Concurrent surveys of residents showed that the control system maintained satisfactory thermal comfort. The control system could reduce the house's total annual heating costs by about $300 (95% confidence interval: 23--34%). These real-world results could strengthen the case for deploying predictive home heating control, bringing the technology one step closer to reducing emissions, utility bills, and power grid impacts at scale.
△ Less
Submitted 10 February, 2024;
originally announced February 2024.
