-
A Practitioner's Guide to Automatic Kernel Search for Gaussian Processes in Battery Applications
Authors:
Huang Zhang,
Xixi Liu,
Faisal Altaf,
Torsten Wik
Abstract:
Gaussian process (GP) models have been used in a wide range of battery applications, in which different kernels were manually selected with considerable expertise. However, to capture complex relationships in the ever-growing amount of real-world data, selecting a suitable kernel for the GP model in battery applications is increasingly challenging. In this work, we first review existing GP kernels…
▽ More
Gaussian process (GP) models have been used in a wide range of battery applications, in which different kernels were manually selected with considerable expertise. However, to capture complex relationships in the ever-growing amount of real-world data, selecting a suitable kernel for the GP model in battery applications is increasingly challenging. In this work, we first review existing GP kernels used in battery applications and then extend an automatic kernel search method with a new base kernel and model selection criteria. The GP models with composite kernels outperform the baseline kernel in two numerical examples of battery applications, i.e., battery capacity estimation and residual load prediction. Particularly, the results indicate that the Bayesian Information Criterion may be the best model selection criterion as it achieves a good trade-off between kernel performance and computational complexity. This work should, therefore, be of value to practitioners wishing to automate their kernel search process in battery applications.
△ Less
Submitted 2 May, 2025;
originally announced May 2025.
-
A Transferable Physics-Informed Framework for Battery Degradation Diagnosis, Knee-Onset Detection and Knee Prediction
Authors:
Huang Zhang,
Xixi Liu,
Faisal Altaf,
Torsten Wik
Abstract:
The techno-economic and safety concerns of battery capacity knee occurrence call for developing online knee detection and prediction methods as an advanced battery management system (BMS) function. To address this, a transferable physics-informed framework that consists of a histogram-based feature engineering method, a hybrid physics-informed model, and a fine-tuning strategy, is proposed for onl…
▽ More
The techno-economic and safety concerns of battery capacity knee occurrence call for developing online knee detection and prediction methods as an advanced battery management system (BMS) function. To address this, a transferable physics-informed framework that consists of a histogram-based feature engineering method, a hybrid physics-informed model, and a fine-tuning strategy, is proposed for online battery degradation diagnosis and knee-onset detection. The hybrid model is first developed and evaluated using a scenario-aware pipeline in protocol cycling scenarios and then fine-tuned to create a local model deployed in a dynamic cycling scenario. A 2D histogram-based feature set is found to be the best choice in both source and target scenarios. The fine-tuning strategy is proven to be effective in improving battery degradation mode estimation and degradation phase detection performance in the target scenario. Again, a strong linear correlation was found between the identified knee-onset and knee points. As a result, advanced BMS functions, such as online degradation diagnosis and prognosis, online knee-onset detection and knee prediction, aging-aware battery classification, and second-life repurposing, can be enabled through a battery performance digital twin in the cloud.
△ Less
Submitted 24 January, 2025;
originally announced January 2025.
-
Comparative Analysis of Control Observer-Based Methods for State Estimation of Lithium-Ion Batteries in Practical Scenarios
Authors:
Muhammad Saeed,
Arash Khalatbarisoltani,
Zhongwei Deng,
Wenxue Liu,
Faisal Altaf,
Shuai Lu,
Xiaosong Hu
Abstract:
The reliability, lower computational complexity, and ease of implementation of control observers make them one of the most promising methods for the state estimation of Li-ion batteries (LIBs) in commercial applications. To pave their way, this study performs a comprehensive and systematic evaluation of four main categories of control observer-based methods in different practical scenarios conside…
▽ More
The reliability, lower computational complexity, and ease of implementation of control observers make them one of the most promising methods for the state estimation of Li-ion batteries (LIBs) in commercial applications. To pave their way, this study performs a comprehensive and systematic evaluation of four main categories of control observer-based methods in different practical scenarios considering estimation accuracy, computational time convergence speed, stability, and robustness against measurement uncertainties. Observers are designed using a second-order equivalent circuit model whose observability against different scenarios is rigorously investigated to verify the feasibility of the proposed analysis. Established techniques then are validated against driving datasets and their comparative usefulness is evaluated using an experimental setup. The analysis also evaluates the adaptability of different techniques to electric vehicle field data. The results indicate better accuracy, stability, robustness, and faster convergence for the PI and PID, while the estimations of the Luenberger observers find it hard to converge against highly dynamic loadfiles. Moreover, this study also discusses the sensitivity of observer-based techniques to battery ohmic polarization and voltage-related measurement uncertainties. The most remarkable contribution of the proposed study lies in providing guidance for researchers when choosing the control observers for online state estimation of LIBs.
△ Less
Submitted 2 December, 2024; v1 submitted 27 November, 2024;
originally announced November 2024.
-
Thermal Modelling of Battery Cells for Optimal Tab and Surface Cooling Control
Authors:
Godwin K. Peprah,
Yicun Huang,
Torsten Wik,
Faisal Altaf,
Changfu Zou
Abstract:
Optimal cooling that minimises thermal gradients and the average temperature is essential for enhanced battery safety and health. This work presents a new modelling approach for battery cells of different shapes by integrating Chebyshev spectral-Galerkin method and model component decomposition. As a result, a library of reduced-order computationally efficient battery thermal models is obtained, c…
▽ More
Optimal cooling that minimises thermal gradients and the average temperature is essential for enhanced battery safety and health. This work presents a new modelling approach for battery cells of different shapes by integrating Chebyshev spectral-Galerkin method and model component decomposition. As a result, a library of reduced-order computationally efficient battery thermal models is obtained, characterised by different numbers of states. These models are validated against a high-fidelity finite element model and are compared with a thermal equivalent circuit (TEC) model under real-world vehicle driving and battery cooling scenarios. Illustrative results demonstrate that the proposed model with four states can faithfully capture the two-dimensional thermal dynamics, while the model with only one state significantly outperforms the widely-used two-state TEC model in both accuracy and computational efficiency, reducing computation time by 28.7%. Furthermore, our developed models allow for independent control of tab and surface cooling channels, enabling effective thermal performance optimisation. Additionally, the proposed model's versatility and effectiveness are demonstrated through various applications, including the evaluation of different cooling scenarios, closed-loop temperature control, and cell design optimisation.
△ Less
Submitted 25 June, 2025; v1 submitted 13 September, 2024;
originally announced September 2024.
-
Battery Capacity Knee-Onset Identification and Early Prediction Using Degradation Curvature
Authors:
Huang Zhang,
Faisal Altaf,
Torsten Wik
Abstract:
Abrupt capacity fade can have a significant impact on performance and safety in battery applications. To address concerns arising from possible knee occurrence, this work aims for a better understanding of their cause by introducing a new definition of capacity knees and their onset. A curvature-based identification of a knee and its onset is proposed, which relies on the discovery of a distinctly…
▽ More
Abrupt capacity fade can have a significant impact on performance and safety in battery applications. To address concerns arising from possible knee occurrence, this work aims for a better understanding of their cause by introducing a new definition of capacity knees and their onset. A curvature-based identification of a knee and its onset is proposed, which relies on the discovery of a distinctly fluctuating behavior in the transition between an initial and a final stable acceleration of the degradation. The method is validated on experimental degradation data of two different battery chemistries, synthetic degradation data, and is also benchmarked to the state-of-the-art knee identification method in the literature. The results demonstrate that our proposed method could successfully identify capacity knees when the state-of-the-art knee identification method failed. Furthermore, a significantly strong correlation is found between knee and end of life (EoL) and almost equally strong between knee onset and EoL. As the method does not require the full capacity fade curve, this opens up online knee-onset identification as well as knee and EoL prediction.
△ Less
Submitted 26 April, 2024; v1 submitted 23 April, 2023;
originally announced April 2023.
-
Pre-text Representation Transfer for Deep Learning with Limited Imbalanced Data : Application to CT-based COVID-19 Detection
Authors:
Fouzia Altaf,
Syed M. S. Islam,
Naeem K. Janjua,
Naveed Akhtar
Abstract:
Annotating medical images for disease detection is often tedious and expensive. Moreover, the available training samples for a given task are generally scarce and imbalanced. These conditions are not conducive for learning effective deep neural models. Hence, it is common to 'transfer' neural networks trained on natural images to the medical image domain. However, this paradigm lacks in performanc…
▽ More
Annotating medical images for disease detection is often tedious and expensive. Moreover, the available training samples for a given task are generally scarce and imbalanced. These conditions are not conducive for learning effective deep neural models. Hence, it is common to 'transfer' neural networks trained on natural images to the medical image domain. However, this paradigm lacks in performance due to the large domain gap between the natural and medical image data. To address that, we propose a novel concept of Pre-text Representation Transfer (PRT). In contrast to the conventional transfer learning, which fine-tunes a source model after replacing its classification layers, PRT retains the original classification layers and updates the representation layers through an unsupervised pre-text task. The task is performed with (original, not synthetic) medical images, without utilizing any annotations. This enables representation transfer with a large amount of training data. This high-fidelity representation transfer allows us to use the resulting model as a more effective feature extractor. Moreover, we can also subsequently perform the traditional transfer learning with this model. We devise a collaborative representation based classification layer for the case when we leverage the model as a feature extractor. We fuse the output of this layer with the predictions of a model induced with the traditional transfer learning performed over our pre-text transferred model. The utility of our technique for limited and imbalanced data classification problem is demonstrated with an extensive five-fold evaluation for three large-scale models, tested for five different class-imbalance ratios for CT based COVID-19 detection. Our results show a consistent gain over the conventional transfer learning with the proposed method.
△ Less
Submitted 20 January, 2023;
originally announced January 2023.
-
Interpretable Battery Cycle Life Range Prediction Using Early Degradation Data at Cell Level
Authors:
Huang Zhang,
Yang Su,
Faisal Altaf,
Torsten Wik,
Sebastien Gros
Abstract:
Battery cycle life prediction using early degradation data has many potential applications throughout the battery product life cycle. For that reason, various data-driven methods have been proposed for point prediction of battery cycle life with minimum knowledge of the battery degradation mechanisms. However, managing the rapidly increasing amounts of batteries at end-of-life with lower economic…
▽ More
Battery cycle life prediction using early degradation data has many potential applications throughout the battery product life cycle. For that reason, various data-driven methods have been proposed for point prediction of battery cycle life with minimum knowledge of the battery degradation mechanisms. However, managing the rapidly increasing amounts of batteries at end-of-life with lower economic and technical risk requires prediction of cycle life with quantified uncertainty, which is still lacking. The interpretability (i.e., the reason for high prediction accuracy) of these advanced data-driven methods is also worthy of investigation. Here, a Quantile Regression Forest (QRF) model, having the advantage of not assuming any specific distribution of cycle life, is introduced to make cycle life range prediction with uncertainty quantified as the width of the prediction interval, in addition to point predictions with high accuracy. The hyperparameters of the QRF model are optimized with a proposed alpha-logistic-weighted criterion so that the coverage probabilities associated with the prediction intervals are calibrated. The interpretability of the final QRF model is explored with two global model-agnostic methods, namely permutation importance and partial dependence plot.
△ Less
Submitted 23 April, 2023; v1 submitted 26 April, 2022;
originally announced April 2022.
-
Resetting the baseline: CT-based COVID-19 diagnosis with Deep Transfer Learning is not as accurate as widely thought
Authors:
Fouzia Altaf,
Syed M. S. Islam,
Naveed Akhtar
Abstract:
Deep learning is gaining instant popularity in computer aided diagnosis of COVID-19. Due to the high sensitivity of Computed Tomography (CT) to this disease, CT-based COVID-19 detection with visual models is currently at the forefront of medical imaging research. Outcomes published in this direction are frequently claiming highly accurate detection under deep transfer learning. This is leading med…
▽ More
Deep learning is gaining instant popularity in computer aided diagnosis of COVID-19. Due to the high sensitivity of Computed Tomography (CT) to this disease, CT-based COVID-19 detection with visual models is currently at the forefront of medical imaging research. Outcomes published in this direction are frequently claiming highly accurate detection under deep transfer learning. This is leading medical technologists to believe that deep transfer learning is the mainstream solution for the problem. However, our critical analysis of the literature reveals an alarming performance disparity between different published results. Hence, we conduct a systematic thorough investigation to analyze the effectiveness of deep transfer learning for COVID-19 detection with CT images. Exploring 14 state-of-the-art visual models with over 200 model training sessions, we conclusively establish that the published literature is frequently overestimating transfer learning performance for the problem, even in the prestigious scientific sources. The roots of overestimation trace back to inappropriate data curation. We also provide case studies that consider more realistic scenarios, and establish transparent baselines for the problem. We hope that our reproducible investigation will help in curbing hype-driven claims for the critical problem of COVID-19 diagnosis, and pave the way for a more transparent performance evaluation of techniques for CT-based COVID-19 detection.
△ Less
Submitted 12 August, 2021;
originally announced August 2021.
-
Boosting Deep Transfer Learning for COVID-19 Classification
Authors:
Fouzia Altaf,
Syed M. S. Islam,
Naeem K. Janjua,
Naveed Akhtar
Abstract:
COVID-19 classification using chest Computed Tomography (CT) has been found pragmatically useful by several studies. Due to the lack of annotated samples, these studies recommend transfer learning and explore the choices of pre-trained models and data augmentation. However, it is still unknown if there are better strategies than vanilla transfer learning for more accurate COVID-19 classification w…
▽ More
COVID-19 classification using chest Computed Tomography (CT) has been found pragmatically useful by several studies. Due to the lack of annotated samples, these studies recommend transfer learning and explore the choices of pre-trained models and data augmentation. However, it is still unknown if there are better strategies than vanilla transfer learning for more accurate COVID-19 classification with limited CT data. This paper provides an affirmative answer, devising a novel `model' augmentation technique that allows a considerable performance boost to transfer learning for the task. Our method systematically reduces the distributional shift between the source and target domains and considers augmenting deep learning with complementary representation learning techniques. We establish the efficacy of our method with publicly available datasets and models, along with identifying contrasting observations in the previous studies.
△ Less
Submitted 16 February, 2021;
originally announced February 2021.
-
Going Deep in Medical Image Analysis: Concepts, Methods, Challenges and Future Directions
Authors:
Fouzia Altaf,
Syed M. S. Islam,
Naveed Akhtar,
Naeem K. Janjua
Abstract:
Medical Image Analysis is currently experiencing a paradigm shift due to Deep Learning. This technology has recently attracted so much interest of the Medical Imaging community that it led to a specialized conference in `Medical Imaging with Deep Learning' in the year 2018. This article surveys the recent developments in this direction, and provides a critical review of the related major aspects.…
▽ More
Medical Image Analysis is currently experiencing a paradigm shift due to Deep Learning. This technology has recently attracted so much interest of the Medical Imaging community that it led to a specialized conference in `Medical Imaging with Deep Learning' in the year 2018. This article surveys the recent developments in this direction, and provides a critical review of the related major aspects. We organize the reviewed literature according to the underlying Pattern Recognition tasks, and further sub-categorize it following a taxonomy based on human anatomy. This article does not assume prior knowledge of Deep Learning and makes a significant contribution in explaining the core Deep Learning concepts to the non-experts in the Medical community. Unique to this study is the Computer Vision/Machine Learning perspective taken on the advances of Deep Learning in Medical Imaging. This enables us to single out `lack of appropriately annotated large-scale datasets' as the core challenge (among other challenges) in this research direction. We draw on the insights from the sister research fields of Computer Vision, Pattern Recognition and Machine Learning etc.; where the techniques of dealing with such challenges have already matured, to provide promising directions for the Medical Imaging community to fully harness Deep Learning in the future.
△ Less
Submitted 14 February, 2019;
originally announced February 2019.
-
Reconfigurable magnetic domain wall pinning at the nano-scale using vortex-generated magnetic fields
Authors:
Aaron C. H. Hurst,
Joshua A. Izaac,
Fouzia Altaf,
Vincent Baltz,
Peter J. Metaxas
Abstract:
We demonstrate that the stray magnetic field generated beneath magnetic vortex cores can be used to generate nano-scale, localized pinning sites for magnetic domain walls in an underlying, perpendicularly magnetized nanostrip. Moreover, the pinning strength can be tuned by toggling the vortex core polarity. Indeed, switching the core polarity so that it is aligned with the magnetization of the exp…
▽ More
We demonstrate that the stray magnetic field generated beneath magnetic vortex cores can be used to generate nano-scale, localized pinning sites for magnetic domain walls in an underlying, perpendicularly magnetized nanostrip. Moreover, the pinning strength can be tuned by toggling the vortex core polarity. Indeed, switching the core polarity so that it is aligned with the magnetization of the expanding domain (rather than against it) can be used to reduce the vortex-mediated wall depinning field by between 40% and 90%, depending on the system geometry. Significant reductions in the depinning field can also be obtained in narrow strips by shifting the core away from the strip's center.
△ Less
Submitted 8 February, 2017;
originally announced February 2017.
