-
GreenHyperSpectra: A multi-source hyperspectral dataset for global vegetation trait prediction
Authors:
Eya Cherif,
Arthur Ouaknine,
Luke A. Brown,
Phuong D. Dao,
Kyle R. Kovach,
Bing Lu,
Daniel Mederer,
Hannes Feilhauer,
Teja Kattenborn,
David Rolnick
Abstract:
Plant traits such as leaf carbon content and leaf mass are essential variables in the study of biodiversity and climate change. However, conventional field sampling cannot feasibly cover trait variation at ecologically meaningful spatial scales. Machine learning represents a valuable solution for plant trait prediction across ecosystems, leveraging hyperspectral data from remote sensing. Neverthel…
▽ More
Plant traits such as leaf carbon content and leaf mass are essential variables in the study of biodiversity and climate change. However, conventional field sampling cannot feasibly cover trait variation at ecologically meaningful spatial scales. Machine learning represents a valuable solution for plant trait prediction across ecosystems, leveraging hyperspectral data from remote sensing. Nevertheless, trait prediction from hyperspectral data is challenged by label scarcity and substantial domain shifts (\eg across sensors, ecological distributions), requiring robust cross-domain methods. Here, we present GreenHyperSpectra, a pretraining dataset encompassing real-world cross-sensor and cross-ecosystem samples designed to benchmark trait prediction with semi- and self-supervised methods. We adopt an evaluation framework encompassing in-distribution and out-of-distribution scenarios. We successfully leverage GreenHyperSpectra to pretrain label-efficient multi-output regression models that outperform the state-of-the-art supervised baseline. Our empirical analyses demonstrate substantial improvements in learning spectral representations for trait prediction, establishing a comprehensive methodological framework to catalyze research at the intersection of representation learning and plant functional traits assessment. All code and data are available at: https://github.com/echerif18/HyspectraSSL.
△ Less
Submitted 9 July, 2025;
originally announced July 2025.
-
A Multi-Perspective Machine Learning Approach to Evaluate Police-Driver Interaction in Los Angeles
Authors:
Benjamin A. T. Grahama,
Lauren Brown,
Georgios Chochlakis,
Morteza Dehghani,
Raquel Delerme,
Brittany Friedman,
Ellie Graeden,
Preni Golazizian,
Rajat Hebbar,
Parsa Hejabi,
Aditya Kommineni,
Mayagüez Salinas,
Michael Sierra-Arévalo,
Jackson Trager,
Nicholas Weller,
Shrikanth Narayanan
Abstract:
Interactions between the government officials and civilians affect public wellbeing and the state legitimacy that is necessary for the functioning of democratic society. Police officers, the most visible and contacted agents of the state, interact with the public more than 20 million times a year during traffic stops. Today, these interactions are regularly recorded by body-worn cameras (BWCs), wh…
▽ More
Interactions between the government officials and civilians affect public wellbeing and the state legitimacy that is necessary for the functioning of democratic society. Police officers, the most visible and contacted agents of the state, interact with the public more than 20 million times a year during traffic stops. Today, these interactions are regularly recorded by body-worn cameras (BWCs), which are lauded as a means to enhance police accountability and improve police-public interactions. However, the timely analysis of these recordings is hampered by a lack of reliable automated tools that can enable the analysis of these complex and contested police-public interactions. This article proposes an approach to developing new multi-perspective, multimodal machine learning (ML) tools to analyze the audio, video, and transcript information from this BWC footage. Our approach begins by identifying the aspects of communication most salient to different stakeholders, including both community members and police officers. We move away from modeling approaches built around the existence of a single ground truth and instead utilize new advances in soft labeling to incorporate variation in how different observers perceive the same interactions. We argue that this inclusive approach to the conceptualization and design of new ML tools is broadly applicable to the study of communication and development of analytic tools across domains of human interaction, including education, medicine, and the workplace.
△ Less
Submitted 9 February, 2024; v1 submitted 24 January, 2024;
originally announced February 2024.
-
An Australian DER Bill of Rights and Responsibilities
Authors:
Niraj Lal,
Lee Brown
Abstract:
Australia's world-leading penetration of distributed solar photovoltaics (PV) is now impacting power system security and as a result how customers can use and export their own PV-generated energy. Several programs of Australian regulatory reform for distributed energy resources (DER) have emphasised the importance of placing consumers at the centre of any energy transition, but this has occurred a…
▽ More
Australia's world-leading penetration of distributed solar photovoltaics (PV) is now impacting power system security and as a result how customers can use and export their own PV-generated energy. Several programs of Australian regulatory reform for distributed energy resources (DER) have emphasised the importance of placing consumers at the centre of any energy transition, but this has occurred against a haphazard backdrop of proposals for solar export taxes, updated inverter standards, and diminishing feed-in-tariffs. Absent from the discussion is a coherent espousal of reasonable consumer expectations with practical technical definitions of how these may be applied. Whilst American legislation has enshrined initial rights to connect PV, they do not consider the evolution of rights in a DER-dominated future. This paper proposes a first attempt at a 'DER Bill of Rights and Responsibilities' for both passive and active participation in energy markets, using Australia as an example jurisdiction. The intent is that clarity on rights to self-consumption and passive participation will support customer trust in the guiderails of active DER integration and control. Guiding principles are presented with practical definitions referencing existing instruments including inverter standards, network connection agreements, the reliability standard, and central ancillary service markets. We highlight how these proposed rights are already being breached regularly in Australia, before outlining a pathway to enshrine them for a DER-dominated future with broad sector endorsement. These questions are critical for Australia to address now; it is likely other countries will be required to do so in the near future.
△ Less
Submitted 16 November, 2022; v1 submitted 9 December, 2021;
originally announced December 2021.
-
Chest X-ray Image Phase Features for Improved Diagnosis of COVID-19 Using Convolutional Neural Network
Authors:
Xiao Qi,
Lloyd Brown,
David J. Foran,
Ilker Hacihaliloglu
Abstract:
Recently, the outbreak of the novel Coronavirus disease 2019 (COVID-19) pandemic has seriously endangered human health and life. Due to limited availability of test kits, the need for auxiliary diagnostic approach has increased. Recent research has shown radiography of COVID-19 patient, such as CT and X-ray, contains salient information about the COVID-19 virus and could be used as an alternative…
▽ More
Recently, the outbreak of the novel Coronavirus disease 2019 (COVID-19) pandemic has seriously endangered human health and life. Due to limited availability of test kits, the need for auxiliary diagnostic approach has increased. Recent research has shown radiography of COVID-19 patient, such as CT and X-ray, contains salient information about the COVID-19 virus and could be used as an alternative diagnosis method. Chest X-ray (CXR) due to its faster imaging time, wide availability, low cost and portability gains much attention and becomes very promising. Computational methods with high accuracy and robustness are required for rapid triaging of patients and aiding radiologist in the interpretation of the collected data. In this study, we design a novel multi-feature convolutional neural network (CNN) architecture for multi-class improved classification of COVID-19 from CXR images. CXR images are enhanced using a local phase-based image enhancement method. The enhanced images, together with the original CXR data, are used as an input to our proposed CNN architecture. Using ablation studies, we show the effectiveness of the enhanced images in improving the diagnostic accuracy. We provide quantitative evaluation on two datasets and qualitative results for visual inspection. Quantitative evaluation is performed on data consisting of 8,851 normal (healthy), 6,045 pneumonia, and 3,323 Covid-19 CXR scans. In Dataset-1, our model achieves 95.57\% average accuracy for a three classes classification, 99\% precision, recall, and F1-scores for COVID-19 cases. For Dataset-2, we have obtained 94.44\% average accuracy, and 95\% precision, recall, and F1-scores for detection of COVID-19. Our proposed multi-feature guided CNN achieves improved results compared to single-feature CNN proving the importance of the local phase-based CXR image enhancement (https://github.com/endiqq/Fus-CNNs_COVID-19).
△ Less
Submitted 14 April, 2021; v1 submitted 6 November, 2020;
originally announced November 2020.
-
Hierarchical Bayesian Model for Probabilistic Analysis of Electric Vehicle Battery Degradation
Authors:
Mehdi Jafari,
Laura E. Brown,
Lucia Gauchia
Abstract:
This paper proposes a hierarchical Bayesian model for probabilistic estimation of the electric vehicle battery capacity fade. Since the battery aging factors such as temperature, current, and state of charge are not fixed, and they change in different times, locations and by the different users, deterministic models with constant parameters cannot accurately evaluate the battery capacity fade. The…
▽ More
This paper proposes a hierarchical Bayesian model for probabilistic estimation of the electric vehicle battery capacity fade. Since the battery aging factors such as temperature, current, and state of charge are not fixed, and they change in different times, locations and by the different users, deterministic models with constant parameters cannot accurately evaluate the battery capacity fade. Therefore, a probabilistic presentation of the capacity fade including uncertainties of the measurements or observations of the variables can be a proper solution. We have developed a hierarchical Bayesian Network model for the electric vehicle battery capacity fade considering multiple external variables. The mathematical expression of the model is extracted based on Bayes theorem, the probability distributions for all variables and their dependencies are carefully chosen where the Metropolis Hastings Markov Chain Monte Carlo sampling method is applied to generate the posterior distributions. The model is trained with 85 percent of experimental data to obtain its unseen parameters and tested with other 15 percent of data to prove its accuracy. Also, three case studies for different drivers, different grid services frequencies, and different climates are explored to show model flexibility with different input data. The developed model needs training data for parameter tuning in different conditions. However, after training, it has more than 95 percent precision in estimating the battery capacity fade percentage.
△ Less
Submitted 4 November, 2019;
originally announced November 2019.
-
Automated Inline Analysis of Myocardial Perfusion MRI with Deep Learning
Authors:
Hui Xue,
Rhodri Davies,
Louis AE Brown,
Kristopher D Knott,
Tushar Kotecha,
Marianna Fontana,
Sven Plein,
James C Moon,
Peter Kellman
Abstract:
Recent development of quantitative myocardial blood flow (MBF) mapping allows direct evaluation of absolute myocardial perfusion, by computing pixel-wise flow maps. Clinical studies suggest quantitative evaluation would be more desirable for objectivity and efficiency. Objective assessment can be further facilitated by segmenting the myocardium and automatically generating reports following the AH…
▽ More
Recent development of quantitative myocardial blood flow (MBF) mapping allows direct evaluation of absolute myocardial perfusion, by computing pixel-wise flow maps. Clinical studies suggest quantitative evaluation would be more desirable for objectivity and efficiency. Objective assessment can be further facilitated by segmenting the myocardium and automatically generating reports following the AHA model. This will free user interaction for analysis and lead to a 'one-click' solution to improve workflow. This paper proposes a deep neural network based computational workflow for inline myocardial perfusion analysis. Adenosine stress and rest perfusion scans were acquired from three hospitals. Training set included N=1,825 perfusion series from 1,034 patients. Independent test set included 200 scans from 105 patients. Data were consecutively acquired at each site. A convolution neural net (CNN) model was trained to provide segmentation for LV cavity, myocardium and right ventricular by processing incoming 2D+T perfusion Gd series. Model outputs were compared to manual ground-truth for accuracy of segmentation and flow measures derived on global and per-sector basis. The trained models were integrated onto MR scanners for effective inference. Segmentation accuracy and myocardial flow measures were compared between CNN models and manual ground-truth. The mean Dice ratio of CNN derived myocardium was 0.93 +/- 0.04. Both global flow and per-sector values showed no significant difference, compared to manual results. The AHA 16 segment model was automatically generated and reported on the MR scanner. As a result, the fully automated analysis of perfusion flow mapping was achieved. This solution was integrated on the MR scanner, enabling 'one-click' analysis and reporting of myocardial blood flow.
△ Less
Submitted 29 May, 2020; v1 submitted 1 November, 2019;
originally announced November 2019.
-
Automated Detection of Left Ventricle in Arterial Input Function Images for Inline Perfusion Mapping using Deep Learning: A study of 15,000 Patients
Authors:
Hui Xue,
Ethan Tseng,
Kristopher D Knott,
Tushar Kotecha,
Louise Brown,
Sven Plein,
Marianna Fontana,
James C Moon,
Peter Kellman
Abstract:
Quantification of myocardial perfusion has the potential to improve detection of regional and global flow reduction. Significant effort has been made to automate the workflow, where one essential step is the arterial input function (AIF) extraction. Since failure here invalidates quantification, high accuracy is required. For this purpose, this study presents a robust AIF detection method using th…
▽ More
Quantification of myocardial perfusion has the potential to improve detection of regional and global flow reduction. Significant effort has been made to automate the workflow, where one essential step is the arterial input function (AIF) extraction. Since failure here invalidates quantification, high accuracy is required. For this purpose, this study presents a robust AIF detection method using the convolutional neural net (CNN) model. CNN models were trained by assembling 25,027 scans (N=12,984 patients) from three hospitals, seven scanners. A test set of 5,721 scans (N=2,805 patients) evaluated model performance. The 2D+T AIF time series was inputted into CNN. Two variations were investigated: a) Two Classes (2CS) for background and foreground (LV mask); b) Three Classes (3CS) for background, foreground LV and RV. Final model was deployed on MR scanners via the Gadgetron InlineAI. Model loading time on MR scanner was ~340ms and applying it took ~180ms. The 3CS model successfully detect LV for 99.98% of all test cases (1 failed out of 5,721 cases). The mean Dice ratio for 3CS was 0.87+/-0.08 with 92.0% of all test cases having Dice ratio >0.75, while the 2CS model gave lower Dice of 0.82+/-0.22 (P<1e-5). Extracted AIF signals using CNN were further compared to manual ground-truth for foot-time, peak-time, first-pass duration, peak value and area-under-curve. No significant differences were found for all features (P>0.2). This study proposed, validated, and deployed a robust CNN solution to detect the LV for the extraction of the AIF signal used in fully automated perfusion flow mapping. A very large data cohort was assembled and resulting models were deployed to MR scanners for fully inline AI in clinical hospitals.
△ Less
Submitted 6 April, 2020; v1 submitted 15 October, 2019;
originally announced October 2019.
-
Automatic In-line Quantitative Myocardial Perfusion Mapping: processing algorithm and implementation
Authors:
Hui Xue,
Louise A. E. Brown,
Sonia Nielles-Vallespin,
Sven Plein,
Peter Kellman
Abstract:
Quantitative myocardial perfusion mapping has advantages over qualitative assessment, including the ability to detect global flow reduction. However, it is not clinically available and remains as a research tool. Building upon the previously described imaging sequence, this paper presents algorithm and implementation of an automated solution for inline perfusion flow mapping with step by step perf…
▽ More
Quantitative myocardial perfusion mapping has advantages over qualitative assessment, including the ability to detect global flow reduction. However, it is not clinically available and remains as a research tool. Building upon the previously described imaging sequence, this paper presents algorithm and implementation of an automated solution for inline perfusion flow mapping with step by step performance characterization.
An inline perfusion flow mapping workflow is proposed and demonstrated on normal volunteers. Initial evaluation demonstrates the fully automated proposed solution for the respiratory motion correction, AIF LV mask detection and pixel-wise mapping, from free-breathing myocardial perfusion imaging.
△ Less
Submitted 15 October, 2019;
originally announced October 2019.
-
Nonlinear Stochastic Position and Attitude Filter on the Special Euclidean Group 3
Authors:
Hashim A. Hashim,
Lyndon J. Brown,
Kenneth McIsaac
Abstract:
This paper formulates the pose estimation problem as nonlinear stochastic filter kinematics evolved directly on the Special Euclidean Group SE(3). Proposed filter guarantees that the errors present in position and Rodriguez vector estimates are semi-globally uniformly ultimately bounded (SGUUB) in mean square, and that they converge to small neighborhood of the origin in probability. Simulation re…
▽ More
This paper formulates the pose estimation problem as nonlinear stochastic filter kinematics evolved directly on the Special Euclidean Group SE(3). Proposed filter guarantees that the errors present in position and Rodriguez vector estimates are semi-globally uniformly ultimately bounded (SGUUB) in mean square, and that they converge to small neighborhood of the origin in probability. Simulation results show the robustness and effectiveness of the proposed filter in presence of high levels of noise and bias associated with the velocity vector as well as body-frame measurements. Keywords: Pose estimator, pose observer, attitude estimate, control, estimator, observer, Nonlinear stochastic pose filter, stochastic differential equations, Brownian motion process, Ito, Stratonovich, Wong Zakai, unit-quaternion, special orthogonal group, homogeneous transformation matrix, complimentary filter, Euler angles, Angle-axis, mapping, Parameterization, Representation, Robust, Multiplicative Extended Kalman Filter, Unscented Kalman Filter, Particle filter, KF, EKF, IEKF, UKF, MEKF, partial derivative, small, dynamics, equilibrium, asymptotic, covariance, expected value, zero, unknown, time-varying, global, semi-global, stable, stability, uncertain, Gaussian, colored, white, noise, vectorial measurement, vector measurement, translational velocity, angular velocity, singular value decomposition, rotational matrix, identity, deterministic, comparison, inertial frame, rigid body, three dimensional, 3D, space, adjoint, Lie group, projection, landmark, feature, Gyroscope, micro electromechanical systems, Inertial measurement units, sensor, IMUs, Fixed, moving, orientation, Roll, Pitch, Yaw, SVD, UAVs, QUAV, unmanned, underwater vehicle, robot, Robotic System, Spacecraft, quadrotor, quadcopter, integral, advantage, disadvantage, Comparative study, Review, Overview, Survey, autonomous, xyz, axis, SO(3), SE(3).
△ Less
Submitted 26 April, 2019; v1 submitted 2 December, 2018;
originally announced December 2018.
-
Nonlinear Stochastic Attitude Filters on the Special Orthogonal Group 3: Ito and Stratonovich
Authors:
Hashim A. Hashim,
Lyndon J. Brown,
Kenneth McIsaac
Abstract:
Two nonlinear stochastic complimentary filters are developed on SO(3). They guarantee that errors in the Rodriguez vector and estimates are semi-globally uniformly ultimately bounded in mean square, and they converge to a small neighborhood of the origin. Simulation results are presented to illustrate the effectiveness of the proposed filters considering high level of uncertainties in angular velo…
▽ More
Two nonlinear stochastic complimentary filters are developed on SO(3). They guarantee that errors in the Rodriguez vector and estimates are semi-globally uniformly ultimately bounded in mean square, and they converge to a small neighborhood of the origin. Simulation results are presented to illustrate the effectiveness of the proposed filters considering high level of uncertainties in angular velocity as well as body-frame vector measurements. Keywords: Attitude estimate, Attitude estimator, Attitude observer, Attitude filter, Nonlinear stochastic filter, stochastic differential equations, Brownian motion process, Ito, Stratonovich, Wong Zakai, Rodriguez vector, unit-quaternion, special orthogonal group 3, Euclidean, Euler angles, Angle-axis, Mapping, Parameterization, Representation, Robust, Invariant, Kalman Filter, Extended Kalman Filter, Multiplicative Extended Kalman Filter, Unscented Kalman Filter, Particle Filter, KF, EKF, MEKF, IEKF, first, second, Partial derivative, operator, probability, small, error, dynamics, kinematics, equilibrium, asymptotic, covariance, mean square, expected value, zero, unknown, time-varying, global, semi-global, stable, stability, uncertain, white noise, Gaussian noise, colored noise, bias, vectorial, vector measurement, angular velocity, singular value decomposition, bounded, rotational matrix, identity, deterministic, orientation, body frame, comparison, inertial frame, rigid body, three dimensional, 3D, space, Attitude Control, Lie algebra, Lie group, projection, Gyroscope, Inertial measurement units, micro electromechanical systems, sensor, IMUs, MEMS, Roll, Pitch, Yaw, UAVs, QUAV, SVD, Fixed, Moving, Vehicles, Robot, Robotic System, Spacecraft, submarine, Underwater vehicle, Problem, advantage, integral, integration, passive complementary filter, Disadvantage, autonomous, Review, Overview, Survey, comparative study, pose, SDEs, SE(3), SO(3).
△ Less
Submitted 23 May, 2020; v1 submitted 7 October, 2018;
originally announced October 2018.
-
Extending UML-RT for Control System Modeling
Authors:
Qimin Gao,
Lyndon J. Brown,
Luiz Fernando Capretz
Abstract:
There is a growing interest in adopting object technologies for the development of real-time control systems. Several commercial tools, currently available, provide object-oriented modeling and design support for real-time control systems. While these products provide many useful facilities, such as visualization tools and automatic code generation, they are all weak in addressing the central char…
▽ More
There is a growing interest in adopting object technologies for the development of real-time control systems. Several commercial tools, currently available, provide object-oriented modeling and design support for real-time control systems. While these products provide many useful facilities, such as visualization tools and automatic code generation, they are all weak in addressing the central characteristic of real-time control systems design, i.e., providing support for a designer to reason about timeliness properties. We believe an approach that integrates the advancements in both object modeling and design methods and real-time scheduling theory is the key to successful use of object technology for real-time software. Surprisingly several past approaches to integrate the two either restrict the object models, or do not allow sophisticated schedulability analysis techniques. This study shows how schedulability analysis can be integrated with UML for Real-Time (UML-RT) to deal with timing properties in real time control systems. More specifically, we develop the schedulability and feasibility analysis modeling for the external messages that may suffer release jitter due to being dispatched by a tick driven scheduler in real-time control system and we also develop the scheduliablity modeling for sporadic activities, where messages arrive sporadically then execute periodically for some bounded time. This method can be used to cope with timing constraints in realistic and complex real-time control systems. Using this method, a designer can quickly evaluate the impact of various implementation decisions on schedulability. In conjunction with automatic code-generation, we believe that this will greatly streamline the design and development of real-time control systems software.
△ Less
Submitted 25 August, 2015;
originally announced August 2015.
-
Integrating Schedulability Analysis with UML-RT
Authors:
Qimin Gao,
Lyndon J Brown,
Luiz Fernando Capretz
Abstract:
The use of object oriented techniques and methodologies for the design of real-time control systems appear to be necessary in order to deal with the increasing complexity of such systems. Recently many object-oriented methods have been used for the modeling and design of real-time control systems. We believe that an approach that integrates the advancements in both object modeling and design metho…
▽ More
The use of object oriented techniques and methodologies for the design of real-time control systems appear to be necessary in order to deal with the increasing complexity of such systems. Recently many object-oriented methods have been used for the modeling and design of real-time control systems. We believe that an approach that integrates the advancements in both object modeling and design methods, and real-time scheduling theory is the key to successful use of object oriented technology for real-time software. However, past approaches to integrate the two either restrict the object models, or do not allow sophisticated schedulability analysis techniques. In this paper we show how schedulability analysis can be integrated with object-oriented design; we develop the schedulability and feasibility analysis method for the external messages that may suffer release jitter due to being dispatched by a tick driven scheduler in real-time control system, and we also develop the scheduliability method for sporadic activities, where message arrive sporadically then execute periodically for some bounded time. This method can be used to cope with timing constraints in complex real-time control systems.
△ Less
Submitted 25 August, 2015;
originally announced August 2015.