Showing 1–22 of 22 results for author: Heer, P

Trajectory-Independent Flexibility Envelopes of Energy-Constrained Systems with State-Dependent Losses

Authors: Julie Rousseau, Carlo Tajoli, Hanmin Cai, Philipp Heer, Kristina Orehounig, Gabriela Hug

Abstract: As non-dispatchable renewable power units become prominent in electric power grids, demand-side flexibility appears as a key element of future power systems' operation. Power and energy bounds are intuitive metrics to describe the flexibility of energy-constrained loads. However, to be used in operation, any power consumption trajectory fulfilling the power and energy bounds must necessarily fulfi… ▽ More As non-dispatchable renewable power units become prominent in electric power grids, demand-side flexibility appears as a key element of future power systems' operation. Power and energy bounds are intuitive metrics to describe the flexibility of energy-constrained loads. However, to be used in operation, any power consumption trajectory fulfilling the power and energy bounds must necessarily fulfill the load's constraints. In this paper, we demonstrate that energy bounds defined as the minimum and maximum energy consumption potential of a load with state-dependent losses are Trajectory-Dependent (TD), i.e., for any energy value in the bounds a feasible power trajectory exists, but not all power trajectories enclosed in the energy envelopes satisfy the load's constraints. To guarantee the satisfaction of load constraints for all trajectories, we define Trajectory-Independent (TI) energy bounds. We present TI envelope formulations for individual loads, as well as physically coupled loads and assess the proposed formulations in a building heating system, a system with state-dependent losses. We find that using a TD envelope as energy bounds in operation may yield room temperature up to 3.8°C higher and 3.4°C lower than admissible. Overall, poorly insulated buildings observe a TI energy envelope that differs significantly from their TD envelope. △ Less

Submitted 22 May, 2025; originally announced May 2025.

Comments: 10 pages

Scalable and Efficient Aggregation of Energy-Constrained Flexible Loads

Authors: Julie Rousseau, Philipp Heer, Kristina Orehounig, Gabriela Hug

Abstract: Loads represent a promising flexibility source to support the integration of renewable energy sources, as they may shift their energy consumption over time. By computing the aggregated flexibility of power and energy-constrained loads, aggregators can communicate the group's flexibility without sharing individual private information. However, this computation is, in practice, challenging. Some stu… ▽ More Loads represent a promising flexibility source to support the integration of renewable energy sources, as they may shift their energy consumption over time. By computing the aggregated flexibility of power and energy-constrained loads, aggregators can communicate the group's flexibility without sharing individual private information. However, this computation is, in practice, challenging. Some studies suggest different inner approximations of aggregated flexibility polytopes, but all suffer from large computational costs for realistic load numbers and horizon lengths. In this paper, we develop a novel approximation of the aggregated flexibility of loads based on the concept of worst-case energy dispatch, i.e., if aggregated energy consumptions are assumed to be dispatched in the worst manner possible. This leads to conservative piecewise linear bounds that restrict the aggregated energy consumption only based on the previous aggregated energy consumed. A comparative case study reveals that our method can compute an approximation of the aggregation of thousands of loads efficiently, while displaying an accuracy comparable to other approximation techniques. △ Less

Submitted 22 May, 2025; originally announced May 2025.

Comments: 6 pages

Plug and Play Distributed Control of Clustered Energy Hub Networks

Authors: Varsha Behrunani, Cara Koepele, Jared Miller, Ahmed Aboudonia, Philipp Heer, Roy S. Smith, John Lygeros

Abstract: The transition to renewable energy is driving the rise of distributed multi-energy systems, in which individual energy hubs and prosumers (e.g., homes, industrial campuses) generate, store, and trade energy. Economic Model Predictive Control (MPC) schemes are widely used to optimize operation of energy hubs by efficiently dispatching resources and minimizing costs while ensuring operational constr… ▽ More The transition to renewable energy is driving the rise of distributed multi-energy systems, in which individual energy hubs and prosumers (e.g., homes, industrial campuses) generate, store, and trade energy. Economic Model Predictive Control (MPC) schemes are widely used to optimize operation of energy hubs by efficiently dispatching resources and minimizing costs while ensuring operational constraints are met. Peer-to-peer (P2P) energy trading among hubs enhances network efficiency and reduces costs but also increases computational and privacy challenges, especially as the network scales. Additionally, current distributed control techniques require global recomputation whenever the network topology changes, limiting scalability. To address these challenges, we propose a clustering-based P2P trading framework that enables plug-and-play operation, allowing energy hubs to seamlessly join or leave without requiring network-wide controller updates. The impact is restricted to the hubs within the affected cluster. The energy trading problem is formulated as a bi-level bargaining game, where inter-cluster trading commitments are determined at the cluster level, while energy dispatch and cost-sharing among hubs within a cluster are refined at the hub level. Both levels are solved in a distributed manner using ADMM, ensuring computational feasibility and privacy preservation. Moreover, we develop plug-and-play procedures to handle dynamic topology changes at both the hub and cluster levels, minimizing disruptions across the network. Simulation results demonstrate that the proposed bi-level framework reduces operational costs, and enables scalable energy management under plug-and-play operation. △ Less

Submitted 8 April, 2025; originally announced April 2025.

Loss-aware Pricing Strategies for Peer-to-Peer Energy Trading

Authors: Varsha N. Behrunani, Philipp Heer, Roy S. Smith, John Lygeros

Abstract: Peer-to-peer(P2P) energy trading may increase efficiency and reduce costs, but introduces significant challenges for network operators such as maintaining grid reliability, accounting for network losses, and redistributing costs equitably. We propose a novel loss-aware pricing strategy for P2P energy markets that addresses these challenges while incentivizing participation in the cooperative energ… ▽ More Peer-to-peer(P2P) energy trading may increase efficiency and reduce costs, but introduces significant challenges for network operators such as maintaining grid reliability, accounting for network losses, and redistributing costs equitably. We propose a novel loss-aware pricing strategy for P2P energy markets that addresses these challenges while incentivizing participation in the cooperative energy trading market. The problem is formulated as a hierarchical Stackelberg game, where a grid operator determines network tariffs while prosumers optimize their trades based on these tariffs while guaranteeing that network constraints are satisfied. The algorithm is designed to minimize and recover their cost from the trading parties, while also minimizing the total cost of the hubs. The mechanism dynamically adjusts tariffs based on location and network topology, discouraging loss-intensive trades. Finally, the complete framework includes the computation of fair trading prices, ensuring all market participants benefit equitably. An ADMM-based hyper-gradient descent method is proposed for solving this problem. Extensive numerical simulations using the benchmark IEEE 33-bus system demonstrate significant cost reductions and improved network efficiency through reduction in network losses compared to constant tariff schemes. Results highlight the adaptability and scalability of the proposed mechanism to varying network configurations and size, demand profiles, and seasonal conditions. △ Less

Submitted 30 March, 2025; originally announced March 2025.

SIMBa: System Identification Methods leveraging Backpropagation

Authors: Loris Di Natale, Muhammad Zakwan, Philipp Heer, Giancarlo Ferrari-Trecate, Colin N. Jones

Abstract: This manuscript details and extends the SIMBa toolbox (System Identification Methods leveraging Backpropagation) presented in previous work, which uses well-established Machine Learning tools for discrete-time linear multi-step-ahead state-space System Identification (SI). SIMBa leverages linear-matrix-inequality-based free parametrizations of Schur matrices to guarantee the stability of the ident… ▽ More This manuscript details and extends the SIMBa toolbox (System Identification Methods leveraging Backpropagation) presented in previous work, which uses well-established Machine Learning tools for discrete-time linear multi-step-ahead state-space System Identification (SI). SIMBa leverages linear-matrix-inequality-based free parametrizations of Schur matrices to guarantee the stability of the identified model by design. In this paper, backed up by novel free parametrizations of Schur matrices, we extend the toolbox to show how SIMBa can incorporate known sparsity patterns or true values of the state-space matrices to identify without jeopardizing stability. We extensively investigate SIMBa's behavior when identifying diverse systems with various properties from both simulated and real-world data. Overall, we find it consistently outperforms traditional stable subspace identification methods, and sometimes significantly, especially when enforcing desired model properties. These results hint at the potential of SIMBa to pave the way for generic structured nonlinear SI. The toolbox is open-sourced on https://github.com/Cemempamoi/simba. △ Less

Submitted 25 September, 2024; v1 submitted 23 November, 2023; originally announced November 2023.

Comments: First two authors contributed equally. Submitted to IEEE TCST

Stable Linear Subspace Identification: A Machine Learning Approach

Authors: Loris Di Natale, Muhammad Zakwan, Bratislav Svetozarevic, Philipp Heer, Giancarlo Ferrari-Trecate, Colin N. Jones

Abstract: Machine Learning (ML) and linear System Identification (SI) have been historically developed independently. In this paper, we leverage well-established ML tools - especially the automatic differentiation framework - to introduce SIMBa, a family of discrete linear multi-step-ahead state-space SI methods using backpropagation. SIMBa relies on a novel Linear-Matrix-Inequality-based free parametrizati… ▽ More Machine Learning (ML) and linear System Identification (SI) have been historically developed independently. In this paper, we leverage well-established ML tools - especially the automatic differentiation framework - to introduce SIMBa, a family of discrete linear multi-step-ahead state-space SI methods using backpropagation. SIMBa relies on a novel Linear-Matrix-Inequality-based free parametrization of Schur matrices to ensure the stability of the identified model. We show how SIMBa generally outperforms traditional linear state-space SI methods, and sometimes significantly, although at the price of a higher computational burden. This performance gap is particularly remarkable compared to other SI methods with stability guarantees, where the gain is frequently above 25% in our investigations, hinting at SIMBa's ability to simultaneously achieve state-of-the-art fitting performance and enforce stability. Interestingly, these observations hold for a wide variety of input-output systems and on both simulated and real-world data, showcasing the flexibility of the proposed approach. We postulate that this new SI paradigm presents a great extension potential to identify structured nonlinear models from data, and we hence open-source SIMBa on https://github.com/Cemempamoi/simba. △ Less

Submitted 26 March, 2024; v1 submitted 6 November, 2023; originally announced November 2023.

Comments: Accepted at ECC 2024

Experimental Validation for Distributed Control of Energy Hubs

Authors: Varsha Behrunani, Philipp Heer, John Lygeros

Abstract: As future energy systems become more decentralised due to the integration of renewable energy resources and storage technologies, several autonomous energy management and peer-to-peer trading mechanisms have been recently proposed for the operation of energy hub networks based on optimization and game theory. However, most of these strategies have been tested either only in simulated environments… ▽ More As future energy systems become more decentralised due to the integration of renewable energy resources and storage technologies, several autonomous energy management and peer-to-peer trading mechanisms have been recently proposed for the operation of energy hub networks based on optimization and game theory. However, most of these strategies have been tested either only in simulated environments or small prosumer units as opposed to larger energy hubs. This simulation reality gap has hindered large-scale implementation and practical application of these method. In this paper, we aim to experimentally validate the performance of a novel multi-horizon distributed model predictive controller for an energy hub network by implementing the controller on a complete network of hubs comprising of a real energy hub inter-faced with multiple virtual hubs. The experiments are done using two different network topologies and the controller shows promising results in both setups. △ Less

Submitted 27 October, 2023; originally announced October 2023.

Comments: 6 pages, 2 figures, CISBAT conference 2023

Data-driven adaptive building thermal controller tuning with constraints: A primal-dual contextual Bayesian optimization approach

Authors: Wenjie Xu, Bratislav Svetozarevic, Loris Di Natale, Philipp Heer, Colin N Jones

Abstract: We study the problem of tuning the parameters of a room temperature controller to minimize its energy consumption, subject to the constraint that the daily cumulative thermal discomfort of the occupants is below a given threshold. We formulate it as an online constrained black-box optimization problem where, on each day, we observe some relevant environmental context and adaptively select the cont… ▽ More We study the problem of tuning the parameters of a room temperature controller to minimize its energy consumption, subject to the constraint that the daily cumulative thermal discomfort of the occupants is below a given threshold. We formulate it as an online constrained black-box optimization problem where, on each day, we observe some relevant environmental context and adaptively select the controller parameters. In this paper, we propose to use a data-driven Primal-Dual Contextual Bayesian Optimization (PDCBO) approach to solve this problem. In a simulation case study on a single room, we apply our algorithm to tune the parameters of a Proportional Integral (PI) heating controller and the pre-heating time. Our results show that PDCBO can save up to 4.7% energy consumption compared to other state-of-the-art Bayesian optimization-based methods while keeping the daily thermal discomfort below the given tolerable threshold on average. Additionally, PDCBO can automatically track time-varying tolerable thresholds while existing methods fail to do so. We then study an alternative constrained tuning problem where we aim to minimize the thermal discomfort with a given energy budget. With this formulation, PDCBO reduces the average discomfort by up to 63% compared to state-of-the-art safe optimization methods while keeping the average daily energy consumption below the required threshold. △ Less

Submitted 1 October, 2023; originally announced October 2023.

Degradation-aware data-enabled predictive control of energy hubs

Authors: Varsha Behrunani, Marta Zagorowska, Mathias Hudoba de Badyn, Francesco Ricca, Philipp Heer, John Lygeros

Abstract: Mitigating the energy use in buildings, together with satisfaction of comfort requirements are the main objectives of efficient building control systems. Augmenting building energy systems with batteries can improve the energy use of a building, while posing the challenge of considering battery degradation during control operation. We demonstrate the performance of a data-enabled predictive contro… ▽ More Mitigating the energy use in buildings, together with satisfaction of comfort requirements are the main objectives of efficient building control systems. Augmenting building energy systems with batteries can improve the energy use of a building, while posing the challenge of considering battery degradation during control operation. We demonstrate the performance of a data-enabled predictive control (DeePC) approach applied to a single multi-zone building and an energy hub comprising an electric heat pump and a battery. In a comparison with a standard rule-based controller, results demonstrate that the performance of DeePC is superior in terms of satisfaction of comfort constraints without increasing grid power consumption. Moreover, DeePC achieved two-fold decrease in battery degradation over one year, as compared to a rule-based controller. △ Less

Submitted 4 July, 2023; originally announced July 2023.

Comments: 6 pages, 1 figure, 1 table. 2023 CISBAT Conference

Distributed Multi-Horizon Model Predictive Control for Network of Energy Hubs

Authors: Varsha Behrunani, Hanmin Cai, Philipp Heer, Roy S. Smith, John Lygeros

Abstract: The increasing penetration of renewable energy resources has transformed the energy system from traditional hierarchical energy delivery paradigm to a distributed structure. Such development is accompanied with continuous liberalization in the energy sector, giving rise to possible energy trading among networked local energy hub. Joint operation of such hubs can improve energy efficiency and suppo… ▽ More The increasing penetration of renewable energy resources has transformed the energy system from traditional hierarchical energy delivery paradigm to a distributed structure. Such development is accompanied with continuous liberalization in the energy sector, giving rise to possible energy trading among networked local energy hub. Joint operation of such hubs can improve energy efficiency and support the integration of renewable energy resource. Acknowledging peer-to-peer trading between hubs, their optimal operation within the network can maximize consumption of locally produced energy. However, for such complex systems involving multiple stakeholders, both computational tractability and privacy concerns need to be accounted for. We investigate both decentralized and centralized model predictive control (MPC) approaches for a network of energy hubs. While the centralized control strategy offers superior performance to the decentralized method, its implementation is computationally prohibitive and raises privacy concerns, as the information of each hub has to be shared extensively. On the other hand, a classical decentralized control approach can ease the implementation at the expense of sub-optimal performance of the overall system. In this work, a distributed scheme based on a consensus alternating direction method of multipliers (ADMM) algorithm is proposed. It combines the performance of the centralized approach with the privacy preservation of decentralized approach. A novel multi-horizon MPC framework is also introduced to increase the prediction horizon without compromising the time discretization or making the problem computationally intractable. A benchmark three-hub network is used to compare the performance of the mentioned methods. The results show superior performance in terms of total cost, computational time, robustness to demand and prices variations. △ Less

Submitted 27 April, 2023; originally announced April 2023.

Comments: 14 pages, 11 Figures

Stochastic MPC for energy hubs using data driven demand forecasting

Authors: Varsha Behrunani, Francesco Micheli, Jonas Mehr, Philipp Heer, John Lygeros

Abstract: Energy hubs convert and distribute energy resources by combining different energy inputs through multiple conversion and storage components. The optimal operation of the energy hub exploits its flexibility to increase the energy efficiency and reduce the operational costs. However, uncertainties in the demand present challenges to energy hub optimization. In this paper, we propose a stochastic MPC… ▽ More Energy hubs convert and distribute energy resources by combining different energy inputs through multiple conversion and storage components. The optimal operation of the energy hub exploits its flexibility to increase the energy efficiency and reduce the operational costs. However, uncertainties in the demand present challenges to energy hub optimization. In this paper, we propose a stochastic MPC controller to minimize energy costs using chance constraints for the uncertain electricity and thermal demands. Historical data is used to build a demand prediction model based on Gaussian processes to generate a forecast of the future electricity and heat demands. The stochastic optimization problem is solved via the Scenario Approach by sampling multi-step demand trajectories from the derived prediction model. The performance of the proposed predictor and of the stochastic controller is verified on a simulated energy hub model and demand data from a real building. △ Less

Submitted 24 July, 2023; v1 submitted 24 April, 2023; originally announced April 2023.

Comments: 6 pages, 5 figures. Submitted to IFAC World Congress 2023

Designing Fairness in Autonomous Peer-to-peer Energy Trading

Authors: Varsha Behrunani, Andrew Irvine, Giuseppe Belgioioso, Philipp Heer, John Lygeros, Florian Dörfler

Abstract: Several autonomous energy management and peer-to-peer trading mechanisms for future energy markets have been recently proposed based on optimization and game theory. In this paper, we study the impact of trading prices on the outcome of these market designs for energy-hub networks. We prove that, for a generic choice of trading prices, autonomous peer-to-peer trading is always network-wide benefic… ▽ More Several autonomous energy management and peer-to-peer trading mechanisms for future energy markets have been recently proposed based on optimization and game theory. In this paper, we study the impact of trading prices on the outcome of these market designs for energy-hub networks. We prove that, for a generic choice of trading prices, autonomous peer-to-peer trading is always network-wide beneficial but not necessarily individually beneficial for each hub. Therefore, we leverage hierarchical game theory to formalize the problem of designing locally-beneficial and network-wide fair peer-to-peer trading prices. Then, we propose a scalable and privacy-preserving price-mediation algorithm that provably converges to a profile of such prices. Numerical simulations on a 3-hub network show that the proposed algorithm can indeed incentivize active participation of energy hubs in autonomous peer-to-peer trading schemes. △ Less

Submitted 9 February, 2023; originally announced February 2023.

Comments: 9 pages, 6 figures. Submitted to IFAC World Congress 2023

Towards Scalable Physically Consistent Neural Networks: an Application to Data-driven Multi-zone Thermal Building Models

Authors: Loris Di Natale, Bratislav Svetozarevic, Philipp Heer, Colin Neil Jones

Abstract: With more and more data being collected, data-driven modeling methods have been gaining in popularity in recent years. While physically sound, classical gray-box models are often cumbersome to identify and scale, and their accuracy might be hindered by their limited expressiveness. On the other hand, classical black-box methods, typically relying on Neural Networks (NNs) nowadays, often achieve im… ▽ More With more and more data being collected, data-driven modeling methods have been gaining in popularity in recent years. While physically sound, classical gray-box models are often cumbersome to identify and scale, and their accuracy might be hindered by their limited expressiveness. On the other hand, classical black-box methods, typically relying on Neural Networks (NNs) nowadays, often achieve impressive performance, even at scale, by deriving statistical patterns from data. However, they remain completely oblivious to the underlying physical laws, which may lead to potentially catastrophic failures if decisions for real-world physical systems are based on them. Physically Consistent Neural Networks (PCNNs) were recently developed to address these aforementioned issues, ensuring physical consistency while still leveraging NNs to attain state-of-the-art accuracy. In this work, we scale PCNNs to model building temperature dynamics and propose a thorough comparison with classical gray-box and black-box methods. More precisely, we design three distinct PCNN extensions, thereby exemplifying the modularity and flexibility of the architecture, and formally prove their physical consistency. In the presented case study, PCNNs are shown to achieve state-of-the-art accuracy, even outperforming classical NN-based models despite their constrained structure. Our investigations furthermore provide a clear illustration of NNs achieving seemingly good performance while remaining completely physics-agnostic, which can be misleading in practice. While this performance comes at the cost of computational complexity, PCNNs on the other hand show accuracy improvements of 17-35% compared to all other physically consistent methods, paving the way for scalable physically consistent models with state-of-the-art performance. △ Less

Submitted 4 April, 2023; v1 submitted 23 December, 2022; originally announced December 2022.

Comments: Accepted in Applied Energy

Near-optimal Deep Reinforcement Learning Policies from Data for Zone Temperature Control

Authors: Loris Di Natale, Bratislav Svetozarevic, Philipp Heer, Colin N. Jones

Abstract: Replacing poorly performing existing controllers with smarter solutions will decrease the energy intensity of the building sector. Recently, controllers based on Deep Reinforcement Learning (DRL) have been shown to be more effective than conventional baselines. However, since the optimal solution is usually unknown, it is still unclear if DRL agents are attaining near-optimal performance in genera… ▽ More Replacing poorly performing existing controllers with smarter solutions will decrease the energy intensity of the building sector. Recently, controllers based on Deep Reinforcement Learning (DRL) have been shown to be more effective than conventional baselines. However, since the optimal solution is usually unknown, it is still unclear if DRL agents are attaining near-optimal performance in general or if there is still a large gap to bridge. In this paper, we investigate the performance of DRL agents compared to the theoretically optimal solution. To that end, we leverage Physically Consistent Neural Networks (PCNNs) as simulation environments, for which optimal control inputs are easy to compute. Furthermore, PCNNs solely rely on data to be trained, avoiding the difficult physics-based modeling phase, while retaining physical consistency. Our results hint that DRL agents not only clearly outperform conventional rule-based controllers, they furthermore attain near-optimal performance. △ Less

Submitted 10 March, 2022; originally announced March 2022.

Comments: Submitted to IEEE ICCA 2022 - 6 pages, 5 figures

Physically Consistent Neural Networks for building thermal modeling: theory and analysis

Authors: Loris Di Natale, Bratislav Svetozarevic, Philipp Heer, Colin N. Jones

Abstract: Due to their high energy intensity, buildings play a major role in the current worldwide energy transition. Building models are ubiquitous since they are needed at each stage of the life of buildings, i.e. for design, retrofitting, and control operations. Classical white-box models, based on physical equations, are bound to follow the laws of physics but the specific design of their underlying str… ▽ More Due to their high energy intensity, buildings play a major role in the current worldwide energy transition. Building models are ubiquitous since they are needed at each stage of the life of buildings, i.e. for design, retrofitting, and control operations. Classical white-box models, based on physical equations, are bound to follow the laws of physics but the specific design of their underlying structure might hinder their expressiveness and hence their accuracy. On the other hand, black-box models are better suited to capture nonlinear building dynamics and thus can often achieve better accuracy, but they require a lot of data and might not follow the laws of physics, a problem that is particularly common for neural network (NN) models. To counter this known generalization issue, physics-informed NNs have recently been introduced, where researchers introduce prior knowledge in the structure of NNs to ground them in known underlying physical laws and avoid classical NN generalization issues. In this work, we present a novel physics-informed NN architecture, dubbed Physically Consistent NN (PCNN), which only requires past operational data and no engineering overhead, including prior knowledge in a linear module running in parallel to a classical NN. We formally prove that such networks are physically consistent - by design and even on unseen data - with respect to different control inputs and temperatures outside and in neighboring zones. We demonstrate their performance on a case study, where the PCNN attains an accuracy up to 40% better than a classical physics-based resistance-capacitance model on 3-day long prediction horizons. Furthermore, despite their constrained structure, PCNNs attain similar performance to classical NNs on the validation data, overfitting the training data less and retaining high expressiveness to tackle the generalization issue. △ Less

Submitted 11 July, 2022; v1 submitted 6 December, 2021; originally announced December 2021.

Comments: Preprint submitted to Applied Energy. 13 pages in the main text + 5 in appendix, 11 figures

Physics-informed linear regression is competitive with two Machine Learning methods in residential building MPC

Authors: Felix Bünning, Benjamin Huber, Adrian Schalbetter, Ahmed Aboudonia, Mathias Hudoba de Badyn, Philipp Heer, Roy S. Smith, John Lygeros

Abstract: Because physics-based building models are difficult to obtain as each building is individual, there is an increasing interest in generating models suitable for building MPC directly from measurement data. Machine learning methods have been widely applied to this problem and validated mostly in simulation; there are, however, few studies on a direct comparison of different models or validation in r… ▽ More Because physics-based building models are difficult to obtain as each building is individual, there is an increasing interest in generating models suitable for building MPC directly from measurement data. Machine learning methods have been widely applied to this problem and validated mostly in simulation; there are, however, few studies on a direct comparison of different models or validation in real buildings to be found in the literature. Methods that are indeed validated in application often lead to computationally complex non-convex optimization problems. Here we compare physics-informed Autoregressive-Moving-Average with Exogenous Inputs (ARMAX) models to Machine Learning models based on Random Forests and Input Convex Neural Networks and the resulting convex MPC schemes in experiments on a practical building application with the goal of minimizing energy consumption while maintaining occupant comfort, and in a numerical case study. We demonstrate that Predictive Control in general leads to savings between 26% and 49% of heating and cooling energy, compared to the building's baseline hysteresis controller. Moreover, we show that all model types lead to satisfactory control performance in terms of constraint satisfaction and energy reduction. However, we also see that the physics-informed ARMAX models have a lower computational burden, and a superior sample efficiency compared to the Machine Learning based models. Moreover, even if abundant training data is available, the ARMAX models have a significantly lower prediction error than the Machine Learning models, which indicates that the encoded physics-based prior of the former cannot independently be found by the latter. △ Less

Submitted 26 January, 2022; v1 submitted 29 October, 2021; originally announced October 2021.

Comments: 17 pages, 11 Figures, submitted to Applied Energy

Journal ref: Applied Energy 310 (2020) 118491

Experimental implementation of an emission-aware prosumer with online flexibility quantification and provision

Authors: Hanmin Cai, Philipp Heer

Abstract: Active building energy management holds potential to reduce global energy-related emissions and support flexible operations of future low-carbon systems. This requires to integrate diverse objectives and engage multiple stakeholders. However, there remains a gap in comprehensive field insights into emission reduction, flexibility provision, and user impacts. This study examined how a real occupied… ▽ More Active building energy management holds potential to reduce global energy-related emissions and support flexible operations of future low-carbon systems. This requires to integrate diverse objectives and engage multiple stakeholders. However, there remains a gap in comprehensive field insights into emission reduction, flexibility provision, and user impacts. This study examined how a real occupied building, with all its energy assets, could function as an emission-aware flexible prosumer. An existing building energy management system was enhanced by integrating a model predictive control strategy. The enhanced setup minimized the equivalent carbon emission due to electricity imports and provided flexibility to the energy system. The experimental results indicated an emission reduction of 12.5% compared to a rule-based controller that maximized PV self-consumption. In addition, a minimal flexibility provision experiment was demonstrated with a locally emulated distribution system operator. The results suggested that flexibility was provided without the risk of rebound effects. This is due to the flexibility envelope that was self-reported in advance. The study concluded by highlighting technical challenges in realizing emission reduction and flexibility in practice. △ Less

Submitted 24 October, 2023; v1 submitted 25 October, 2021; originally announced October 2021.

Data-Driven Demand-Side Flexibility Quantification: Prediction and Approximation of Flexibility Envelopes

Authors: Nami Hekmat, Hanmin Cai, Thierry Zufferey, Gabriela Hug, Philipp Heer

Abstract: Real-time quantification of residential building energy flexibility is needed to enable a cost-efficient operation of active distribution grids. A promising means is to use the so-called flexibility envelope concept to represent the time-dependent and inter-temporally coupled flexibility potential. However, existing optimization-based quantification entails high computational burdens limiting flex… ▽ More Real-time quantification of residential building energy flexibility is needed to enable a cost-efficient operation of active distribution grids. A promising means is to use the so-called flexibility envelope concept to represent the time-dependent and inter-temporally coupled flexibility potential. However, existing optimization-based quantification entails high computational burdens limiting flexibility utilization in real-time applications, and a more computationally efficient quantification approach is desired. Additionally, the communication of a flexibility envelope to system operators in its original form is data-intensive. In order to address the computational burdens, this paper first trains several machine learning models based on historical quantification results for online use. Subsequently, probability distribution functions are proposed to approximate the flexibility envelopes with significantly fewer parameters, which can be communicated to system operators instead of the original flexibility envelope. The results show that the most promising prediction and approximation approaches allow for a minimum reduction of the computational burden by a factor of 9 and of the communication load by a factor of 6.6, respectively. △ Less

Submitted 5 May, 2022; v1 submitted 25 October, 2021; originally announced October 2021.

Data-driven control of room temperature and bidirectional EV charging using deep reinforcement learning: simulations and experiments

Authors: B. Svetozarevic, C. Baumann, S. Muntwiler, L. Di Natale, M. Zeilinger, P. Heer

Abstract: This work presents a fully data-driven, black-box pipeline to obtain an optimal control policy for a multi-loop building control problem based on historical building and weather data, thus without the need for complex physics-based modelling. We demonstrate the method for joint control of room temperature and bidirectional EV charging to maximize the occupant thermal comfort and energy savings whi… ▽ More This work presents a fully data-driven, black-box pipeline to obtain an optimal control policy for a multi-loop building control problem based on historical building and weather data, thus without the need for complex physics-based modelling. We demonstrate the method for joint control of room temperature and bidirectional EV charging to maximize the occupant thermal comfort and energy savings while leaving enough energy in the EV battery for the next trip. We modelled the room temperature with a recurrent neural network and EV charging with a piece-wise linear function. Using these models as a simulation environment, we applied a deep reinforcement learning (DRL) algorithm to obtain an optimal control policy. The learnt policy achieves on average 17% energy savings over the heating season and 19% better comfort satisfaction than a standard RB room temperature controller. When a bidirectional EV is additionally connected and a two-tariff electricity pricing is applied, the MIMO DRL policy successfully leverages the battery and decreases the overall cost of electricity compared to two standard RB controllers, one controlling the room temperature and another controlling the bidirectional EV (dis-)charging. Finally, we demonstrate a successful transfer of the learnt DRL policy from simulation onto a real building, the DFAB HOUSE at Empa Duebendorf in Switzerland, achieving up to 30% energy savings while maintaining similar comfort levels compared to a conventional RB room temperature controller over three weeks during the heating season. △ Less

Submitted 17 June, 2021; v1 submitted 2 March, 2021; originally announced March 2021.

Comments: 20 pages, 17 figures, 3 tables

Input Convex Neural Networks for Building MPC

Authors: Felix Bünning, Adrian Schalbetter, Ahmed Aboudonia, Mathias Hudoba de Badyn, Philipp Heer, John Lygeros

Abstract: Model Predictive Control in buildings can significantly reduce their energy consumption. The cost and effort necessary for creating and maintaining first principle models for buildings make data-driven modelling an attractive alternative in this domain. In MPC the models form the basis for an optimization problem whose solution provides the control signals to be applied to the system. The fact tha… ▽ More Model Predictive Control in buildings can significantly reduce their energy consumption. The cost and effort necessary for creating and maintaining first principle models for buildings make data-driven modelling an attractive alternative in this domain. In MPC the models form the basis for an optimization problem whose solution provides the control signals to be applied to the system. The fact that this optimization problem has to be solved repeatedly in real-time implies restrictions on the learning architectures that can be used. Here, we adapt Input Convex Neural Networks that are generally only convex for one-step predictions, for use in building MPC. We introduce additional constraints to their structure and weights to achieve a convex input-output relationship for multistep ahead predictions. We assess the consequences of the additional constraints for the model accuracy and test the models in a real-life MPC experiment in an apartment in Switzerland. In two five-day cooling experiments, MPC with Input Convex Neural Networks is able to keep room temperatures within comfort constraints while minimizing cooling energy consumption. △ Less

Submitted 26 November, 2020; originally announced November 2020.

Comments: 11 pages, 7 figures, 1 table

Temporal Resolution of Measurements and the Effects on Calibrating Building Energy Models

Authors: Fazel Khayatian, Andrew Bollinger, Philipp Heer

Abstract: With the recent interest in installing building energy management systems, the availability of data enables calibration of building energy models. This study compares calibration on eight different temporal resolutions and contrasts the benefits and drawbacks of each. While calibrating heating and cooling energy consumption shows less sensitivity to the temporal resolution, the accuracy of electri… ▽ More With the recent interest in installing building energy management systems, the availability of data enables calibration of building energy models. This study compares calibration on eight different temporal resolutions and contrasts the benefits and drawbacks of each. While calibrating heating and cooling energy consumption shows less sensitivity to the temporal resolution, the accuracy of electricity energy consumption and domestic hot water greatly varies depending on the temporal resolution. △ Less

Submitted 8 March, 2022; v1 submitted 4 November, 2020; originally announced November 2020.

Comments: eSIM2021 accepted article

Robust MPC with data-driven demand forecasting for frequency regulation with heat pumps

Authors: Felix Bünning, Joseph Warrington, Philipp Heer, Roy S. Smith, John Lygeros

Abstract: With the increased amount of volatile renewable energy sources connected to the electricity grid, and the phase-out of fossil fuel based power plants, there is an increased need for frequency regulation. On the demand side, frequency regulation services can be offered by buildings or districts that are equipped with electric heating or cooling systems, by exploiting their thermal inertia. Existing… ▽ More With the increased amount of volatile renewable energy sources connected to the electricity grid, and the phase-out of fossil fuel based power plants, there is an increased need for frequency regulation. On the demand side, frequency regulation services can be offered by buildings or districts that are equipped with electric heating or cooling systems, by exploiting their thermal inertia. Existing approaches for tapping into this potential typically rely on dynamic building models, which in practice can be challenging to obtain and maintain. As a result, practical implementations of such systems are scarce. Moreover, actively controlling buildings requires extensive control infrastructure and may cause privacy concerns in district energy systems. Motivated by this, we exploit the thermal inertia of buffer storage for reserves, reducing the building models to demand forecasts here. By combining a control scheme based on Robust Model Predictive Control, with affine policies, and heating demand forecasting based on Artificial Neural Networks with online correction methods, we offer frequency regulation reserves and maintain user comfort with a system comprising a heat pump and buffer storage. While the robust approach ensures occupant comfort, the use of affine policies reduces the effect of disturbance uncertainty on the system state. In a first-of-its-kind experiment with a real district-like building energy system, we demonstrate that the scheme is able to offer reserves in a variety of conditions and track a regulation signal while meeting the heating demand of the connected buildings. 13.4% of the consumed electricity is flexible. In additional numerical studies, we demonstrate that using affine policies significantly decreases the cost function and increases the amount of offered reserves and we investigate the suboptimality in comparison to an omniscient control system. △ Less

Submitted 14 February, 2022; v1 submitted 15 September, 2020; originally announced September 2020.

Comments: 16 pages, 12 figures, 1 table

Journal ref: Control Engineering Practice (2022), 122, 105101