-
Valuation of Public Bus Electrification with Open Data
Authors:
Upadhi Vijay,
Soomin Woo,
Scott J. Moura,
Akshat Jain,
David Rodriguez,
Sergio Gambacorta,
Giuseppe Ferrara,
Luigi Lanuzza,
Christian Zulberti,
Erika Mellekas,
Carlo Papa
Abstract:
This research provides a novel framework to estimate the economic, environmental, and social values of electrifying public transit buses, for cities across the world, based on open-source data. Electric buses are a compelling candidate to replace diesel buses for the environmental and social benefits. However, the state-of-art models to evaluate the value of bus electrification are limited in appl…
▽ More
This research provides a novel framework to estimate the economic, environmental, and social values of electrifying public transit buses, for cities across the world, based on open-source data. Electric buses are a compelling candidate to replace diesel buses for the environmental and social benefits. However, the state-of-art models to evaluate the value of bus electrification are limited in applicability because they require granular and bespoke data on bus operation that can be difficult to procure. Our valuation tool uses General Transit Feed Specification, a standard data format used by transit agencies worldwide, to provide high-level guidance on developing a prioritization strategy for electrifying a bus fleet. We develop physics-informed machine learning models to evaluate the energy consumption, the carbon emissions, the health impacts, and the total cost of ownership for each transit route. We demonstrate the scalability of our tool with a case study of the bus lines in the Greater Boston and Milan metropolitan areas.
△ Less
Submitted 24 September, 2022;
originally announced September 2022.
-
A Learning-based Optimal Market Bidding Strategy for Price-Maker Energy Storage
Authors:
Mathilde D. Badoual,
Scott J. Moura
Abstract:
Load serving entities with storage units reach sizes and performances that can significantly impact clearing prices in electricity markets. Nevertheless, price endogeneity is rarely considered in storage bidding strategies and modeling the electricity market is a challenging task. Meanwhile, model-free reinforcement learning such as the Actor-Critic are becoming increasingly popular for designing…
▽ More
Load serving entities with storage units reach sizes and performances that can significantly impact clearing prices in electricity markets. Nevertheless, price endogeneity is rarely considered in storage bidding strategies and modeling the electricity market is a challenging task. Meanwhile, model-free reinforcement learning such as the Actor-Critic are becoming increasingly popular for designing energy system controllers. Yet implementation frequently requires lengthy, data-intense, and unsafe trial-and-error training. To fill these gaps, we implement an online Supervised Actor-Critic (SAC) algorithm, supervised with a model-based controller -- Model Predictive Control (MPC). The energy storage agent is trained with this algorithm to optimally bid while learning and adjusting to its impact on the market clearing prices. We compare the supervised Actor-Critic algorithm with the MPC algorithm as a supervisor, finding that the former reaps higher profits via learning. Our contribution, thus, is an online and safe SAC algorithm that outperforms the current model-based state-of-the-art.
△ Less
Submitted 4 June, 2021;
originally announced June 2021.
-
State Estimation for a Zero-Dimensional Electrochemical Model of Lithium-Sulfur Batteries
Authors:
Zhijia Huang,
Dong Zhang,
Luis D. Couto,
Quan-Hong Yang,
Scott J. Moura
Abstract:
Lithium-sulfur (Li-S) batteries have become one of the most attractive alternatives over conventional Li-ion batteries due to their high theoretical specific energy density (2500 Wh/kg for Li-S vs. $\sim$250 Wh/kg for Li-ion). Accurate state estimation in Li-S batteries is urgently needed for safe and efficient operation. To the best of the authors' knowledge, electrochemical model-based observers…
▽ More
Lithium-sulfur (Li-S) batteries have become one of the most attractive alternatives over conventional Li-ion batteries due to their high theoretical specific energy density (2500 Wh/kg for Li-S vs. $\sim$250 Wh/kg for Li-ion). Accurate state estimation in Li-S batteries is urgently needed for safe and efficient operation. To the best of the authors' knowledge, electrochemical model-based observers have not been reported for Li-S batteries, primarily due to the complex dynamics that make state observer design a challenging problem. In this work, we demonstrate a state estimation scheme based on a zero-dimensional electrochemical model for Li-S batteries. The nonlinear differential-algebraic equation (DAE) model is incorporated into an extend Kalman filter. This observer design estimates both differential and algebraic states that represent the dynamic behavior inside the cell, from voltage and current measurements only. The effectiveness of the proposed estimation algorithm is illustrated by numerical simulation results. Our study unlocks how an electrochemical model can be utilized for practical state estimation of Li-S batteries.
△ Less
Submitted 25 January, 2021;
originally announced January 2021.
-
Safe Learning MPC with Limited Model Knowledge and Data
Authors:
Aaron Kandel,
Scott J. Moura
Abstract:
This paper presents an end-to-end framework for safe learning-based control (LbC) using nonlinear stochastic MPC and distributionally robust optimization (DRO). This work is motivated by several open challenges in LbC literature. In particular, many control-theoretic LbC methods require subject matter expertise in order to translate their own safety guarantees, often manifested as preexisting data…
▽ More
This paper presents an end-to-end framework for safe learning-based control (LbC) using nonlinear stochastic MPC and distributionally robust optimization (DRO). This work is motivated by several open challenges in LbC literature. In particular, many control-theoretic LbC methods require subject matter expertise in order to translate their own safety guarantees, often manifested as preexisting data of safe trajectories or structural model knowledge. In this paper, we focus on LbC where the controller is applied directly to a system of which it has no or extremely limited direct experience, towards safety during \textit{tabula-rasa} or ``\textit{blank slate''} model-based learning and control as a challenging case for validation. This explores the boundary of the status-quo in control theory relating to requirements for subject matter expertise. We show under basic and limited assumptions on the underlying problem, we can translate probabilistic guarantees on feasibility to nonlinear systems using results in stochastic MPC and DRO literature whose relevance we formally extend in a mathematical analysis. We also present a coupled and intuitive formulation for persistence of excitation (PoE), and illustrate the connection between PoE and applicability of the proposed method. Our case studies of vehicle obstacle avoidance and safe extreme fast charging of lithium-ion batteries reveal powerful empirical results supporting the underlying DRO theory. Our method is widely applicable within the LbC domain to, for example, airborne wind energy systems, vehicle obstacle avoidance, and energy storage systems management. It is also applicable to quantifying uncertainty beyond the LbC case.
△ Less
Submitted 21 August, 2023; v1 submitted 1 April, 2020;
originally announced April 2020.
-
State of Charge Estimation of Parallel Connected Battery Cells via Descriptor System Theory
Authors:
Dong Zhang,
Luis D. Couto,
Sebastien Benjamin,
Wente Zeng,
Daniel F. Coutinho,
Scott J. Moura
Abstract:
This manuscript presents an algorithm for individual Lithium-ion (Li-ion) battery cell state of charge (SOC) estimation when multiple cells are connected in parallel, using only terminal voltage and total current measurements. For battery packs consisting of thousands of cells, it is desirable to estimate individual SOCs by only monitoring the total current in order to reduce sensing cost. Mathema…
▽ More
This manuscript presents an algorithm for individual Lithium-ion (Li-ion) battery cell state of charge (SOC) estimation when multiple cells are connected in parallel, using only terminal voltage and total current measurements. For battery packs consisting of thousands of cells, it is desirable to estimate individual SOCs by only monitoring the total current in order to reduce sensing cost. Mathematically, series connected cells yield dynamics given by ordinary differential equations under classical full voltage sensing. In contrast, parallel connected cells are evidently more challenging because the dynamics are governed by a nonlinear descriptor system, including differential equations and algebraic equations arising from voltage and current balance across cells. An observer with linear output error injection is formulated, where the individual cell SOCs and local currents are locally observable from the total current and voltage measurements. The asymptotic convergence of differential and algebraic states is established by considering local Lipschitz continuity property of system nonlinearities. Simulation results on LiNiMnCoO$_2$/Graphite (NMC) cells illustrate convergence for SOCs, local currents, and terminal voltage.
△ Less
Submitted 17 March, 2020;
originally announced March 2020.
-
Bayesian Hierarchical Methods for Modeling Electrical Grid Component Failures
Authors:
Laurel N. Dunn,
Ioanna Kavvada,
Mathilde Badoual,
Scott J. Moura
Abstract:
Failure probabilities for grid components are often estimated using parametric models which can capitalize on operational grid data. This work formulates a Bayesian hierarchical framework designed to integrate data and domain expertise to understand the failure properties of a regional power system, where variability in the expected performance of individual components gives rise to failure proces…
▽ More
Failure probabilities for grid components are often estimated using parametric models which can capitalize on operational grid data. This work formulates a Bayesian hierarchical framework designed to integrate data and domain expertise to understand the failure properties of a regional power system, where variability in the expected performance of individual components gives rise to failure processes that are heterogeneous and uncertain. We use Bayesian methods to fit failure models to failure data generated in simulation. We test our algorithm by evaluating differences between the data-generating model, our Bayesian hierarchical model, and maximum likelihood parameter estimates. We evaluate how well each model can approximate the failure properties of individual components, and of the system overall. Finally, we define an upgrade policy for achieving targeted reductions in risk exposure, and compare the magnitude of upgrades recommended by each model.
△ Less
Submitted 21 January, 2020;
originally announced January 2020.
-
On Wind Speed Sensor Configurations and Altitude Control in Airborne Wind Energy Systems
Authors:
Laurel N. Dunn,
Christopher Vermillion,
Fotini K. Chow,
Scott J. Moura
Abstract:
Real-time altitude control of airborne wind energy (AWE) systems can improve performance by allowing turbines to track favorable wind speeds across a range of operating altitudes. The current work explores the performance implications of deploying an AWE system with sensor configurations that provide different amounts of data to characterize wind speed profiles. We examine various control objectiv…
▽ More
Real-time altitude control of airborne wind energy (AWE) systems can improve performance by allowing turbines to track favorable wind speeds across a range of operating altitudes. The current work explores the performance implications of deploying an AWE system with sensor configurations that provide different amounts of data to characterize wind speed profiles. We examine various control objectives that balance trade-offs between exploration and exploitation, and use a persistence model to generate a probabilistic wind speed forecast to inform control decisions. We assess system performance by comparing power production against baselines such as omniscient control and stationary flight. We show that with few sensors, control strategies that reward exploration are favored. We also show that with comprehensive sensing, the implications of choosing a sub-optimal control strategy decrease. This work informs and motivates the need for future research exploring online learning algorithms to characterize vertical wind speed profiles.
△ Less
Submitted 21 January, 2020;
originally announced January 2020.