-
Ga$_2$O$_3$ TCAD Mobility Parameter Calibration using Simulation Augmented Machine Learning with Physics Informed Neural Network
Authors:
Le Minh Long Nguyen,
Edric Ong,
Matthew Eng,
Yuhao Zhang,
Hiu Yung Wong
Abstract:
In this paper, we demonstrate the possibility of performing automatic Technology Computer-Aided-Design (TCAD) parameter calibration using machine learning, verified with experimental data. The machine only needs to be trained by TCAD data. Schottky Barrier Diode (SBD) fabricated with emerging ultra-wide-bandgap material, Gallium Oxide (Ga$_2$O$_3$), is measured and its current-voltage (IV) is used…
▽ More
In this paper, we demonstrate the possibility of performing automatic Technology Computer-Aided-Design (TCAD) parameter calibration using machine learning, verified with experimental data. The machine only needs to be trained by TCAD data. Schottky Barrier Diode (SBD) fabricated with emerging ultra-wide-bandgap material, Gallium Oxide (Ga$_2$O$_3$), is measured and its current-voltage (IV) is used for Ga$_2$O$_3$ Philips Unified Mobility (PhuMob) model parameters, effective anode workfunction, and ambient temperature extraction (7 parameters). A machine comprised of an autoencoder (AE) and a neural network (NN) (AE-NN) is used. Ga$_2$O$_3$ PhuMob parameters are extracted from the noisy experimental curves. TCAD simulation with the extracted parameters shows that the quality of the parameters is as good as an expert's calibration at the pre-turned-on regime but not in the on-state regime. By using a simple physics-informed neural network (PINN) (AE-PINN), the machine performs as well as the human expert in all regimes.
△ Less
Submitted 3 April, 2025;
originally announced April 2025.
-
On the Statistical Capacity of Deep Generative Models
Authors:
Edric Tam,
David B. Dunson
Abstract:
Deep generative models are routinely used in generating samples from complex, high-dimensional distributions. Despite their apparent successes, their statistical properties are not well understood. A common assumption is that with enough training data and sufficiently large neural networks, deep generative model samples will have arbitrarily small errors in sampling from any continuous target dist…
▽ More
Deep generative models are routinely used in generating samples from complex, high-dimensional distributions. Despite their apparent successes, their statistical properties are not well understood. A common assumption is that with enough training data and sufficiently large neural networks, deep generative model samples will have arbitrarily small errors in sampling from any continuous target distribution. We set up a unifying framework that debunks this belief. We demonstrate that broad classes of deep generative models, including variational autoencoders and generative adversarial networks, are not universal generators. Under the predominant case of Gaussian latent variables, these models can only generate concentrated samples that exhibit light tails. Using tools from concentration of measure and convex geometry, we give analogous results for more general log-concave and strongly log-concave latent variable distributions. We extend our results to diffusion models via a reduction argument. We use the Gromov--Levy inequality to give similar guarantees when the latent variables lie on manifolds with positive Ricci curvature. These results shed light on the limited capacity of common deep generative models to handle heavy tails. We illustrate the empirical relevance of our work with simulations and financial data.
△ Less
Submitted 13 January, 2025;
originally announced January 2025.
-
A Distributional Evaluation of Generative Image Models
Authors:
Edric Tam,
Barbara E Engelhardt
Abstract:
Generative models are ubiquitous in modern artificial intelligence (AI) applications. Recent advances have led to a variety of generative modeling approaches that are capable of synthesizing highly realistic samples. Despite these developments, evaluating the distributional match between the synthetic samples and the target distribution in a statistically principled way remains a core challenge. W…
▽ More
Generative models are ubiquitous in modern artificial intelligence (AI) applications. Recent advances have led to a variety of generative modeling approaches that are capable of synthesizing highly realistic samples. Despite these developments, evaluating the distributional match between the synthetic samples and the target distribution in a statistically principled way remains a core challenge. We focus on evaluating image generative models, where studies often treat human evaluation as the gold standard. Commonly adopted metrics, such as the Fréchet Inception Distance (FID), do not sufficiently capture the differences between the learned and target distributions, because the assumption of normality ignores differences in the tails. We propose the Embedded Characteristic Score (ECS), a comprehensive metric for evaluating the distributional match between the learned and target sample distributions, and explore its connection with moments and tail behavior. We derive natural properties of ECS and show its practical use via simulations and an empirical study.
△ Less
Submitted 1 January, 2025;
originally announced January 2025.
-
That Flick is Sick: Gyroscope Integration in Xbox Controllers
Authors:
Jhervey Edric Cheng,
Stacy Selena Kalaw,
James Patrick Kok,
Alyssa Ysabelle Meneses,
Richard Sy,
Jordan Aiko Deja
Abstract:
Gyroscope integration in Xbox controllers offers new possibilities for enhancing gaming experiences, particularly in first-person shooter (FPS) games. To investigate its potential, we conducted an empirical study with 11 participants, comparing aim precision and reaction times across three input methods: a computer mouse, a standard Xbox controller, and a gyroscope-enabled controller. Participants…
▽ More
Gyroscope integration in Xbox controllers offers new possibilities for enhancing gaming experiences, particularly in first-person shooter (FPS) games. To investigate its potential, we conducted an empirical study with 11 participants, comparing aim precision and reaction times across three input methods: a computer mouse, a standard Xbox controller, and a gyroscope-enabled controller. Participants completed an aim training task, revealing the mouse as the most accurate device, followed by the standard controller. Interestingly, the gyroscope-enabled controller showed reduced accuracy and slower reaction times, attributed to challenges in sensitivity and control. Participant feedback highlighted areas for improvement, including refined sensitivity settings, control stability, and software design. These findings underscore the need for design innovations, such as camera rotation limits and optimized sensitivity thresholds, to make gyroscope-enabled controllers more competitive. Future work should consider diverse gamer profiles and extended evaluation contexts to better understand the role of gyroscopes in gaming interfaces.
△ Less
Submitted 23 November, 2024;
originally announced November 2024.
-
Innovative Weight Simulation in Virtual Reality Cube Games: A Pseudo-Haptic Approach
Authors:
Woan Ning Lim,
Edric Yi Junn Leong,
Yun Li Lee,
Kian Meng Yap
Abstract:
This paper presents an innovative pseudo-haptic model for weight simulation in virtual reality (VR) environments. By integrating visual feedback with voluntary exerted force through a passive haptic glove, the model creates haptic illusions of weight perception. Two VR cube games were developed to evaluate the model's effectiveness. The first game assesses participants' ability to discriminate rel…
▽ More
This paper presents an innovative pseudo-haptic model for weight simulation in virtual reality (VR) environments. By integrating visual feedback with voluntary exerted force through a passive haptic glove, the model creates haptic illusions of weight perception. Two VR cube games were developed to evaluate the model's effectiveness. The first game assesses participants' ability to discriminate relative weights, while the second evaluates their capability to estimate absolute weights. Twelve participants, aged 18 to 59, tested the games. Results suggest that the pseudo-haptic model is effective for relative weight discrimination tasks and holds potential for various VR applications. Further research with a larger participant group and more complex scenarios is recommended to refine and validate the model.
△ Less
Submitted 7 November, 2024;
originally announced November 2024.
-
Unbiased Regression Loss for DETRs
Authors:
Edric,
Ueta Daisuke,
Kurokawa Yukimasa,
Karlekar Jayashree,
Sugiri Pranata
Abstract:
In this paper, we introduce a novel unbiased regression loss for DETR-based detectors. The conventional $L_{1}$ regression loss tends to bias towards larger boxes, as they disproportionately contribute more towards the overall loss compared to smaller boxes. Consequently, the detection performance for small objects suffers. To alleviate this bias, the proposed new unbiased loss, termed Sized…
▽ More
In this paper, we introduce a novel unbiased regression loss for DETR-based detectors. The conventional $L_{1}$ regression loss tends to bias towards larger boxes, as they disproportionately contribute more towards the overall loss compared to smaller boxes. Consequently, the detection performance for small objects suffers. To alleviate this bias, the proposed new unbiased loss, termed Sized $L_{1}$ loss, normalizes the size of all boxes based on their individual width and height. Our experiments demonstrate consistent improvements in both fully-supervised and semi-supervised settings using the MS-COCO benchmark dataset.
△ Less
Submitted 29 October, 2024;
originally announced October 2024.
-
Spectral Gap Regularization of Neural Networks
Authors:
Edric Tam,
David Dunson
Abstract:
We introduce Fiedler regularization, a novel approach for regularizing neural networks that utilizes spectral/graphical information. Existing regularization methods often focus on penalizing weights in a global/uniform manner that ignores the connectivity structure of the neural network. We propose to use the Fiedler value of the neural network's underlying graph as a tool for regularization. We p…
▽ More
We introduce Fiedler regularization, a novel approach for regularizing neural networks that utilizes spectral/graphical information. Existing regularization methods often focus on penalizing weights in a global/uniform manner that ignores the connectivity structure of the neural network. We propose to use the Fiedler value of the neural network's underlying graph as a tool for regularization. We provide theoretical motivation for this approach via spectral graph theory. We demonstrate several useful properties of the Fiedler value that make it useful as a regularization tool. We provide an approximate, variational approach for faster computation during training. We provide an alternative formulation of this framework in the form of a structurally weighted $\text{L}_1$ penalty, thus linking our approach to sparsity induction. We provide uniform generalization error bounds for Fiedler regularization via a Rademacher complexity analysis. We performed experiments on datasets that compare Fiedler regularization with classical regularization methods such as dropout and weight decay. Results demonstrate the efficacy of Fiedler regularization. This is a journal extension of the conference paper by Tam and Dunson (2020).
△ Less
Submitted 6 April, 2023;
originally announced April 2023.
-
Quantum Optimisation for Continuous Multivariable Functions by a Structured Search
Authors:
Edric Matwiejew,
Jason Pye,
Jingbo B. Wang
Abstract:
Solving optimisation problems is a promising near-term application of quantum computers. Quantum variational algorithms leverage quantum superposition and entanglement to optimise over exponentially large solution spaces using an alternating sequence of classically tunable unitaries. However, prior work has primarily addressed discrete optimisation problems. In addition, these algorithms have been…
▽ More
Solving optimisation problems is a promising near-term application of quantum computers. Quantum variational algorithms leverage quantum superposition and entanglement to optimise over exponentially large solution spaces using an alternating sequence of classically tunable unitaries. However, prior work has primarily addressed discrete optimisation problems. In addition, these algorithms have been designed generally under the assumption of an unstructured solution space, which constrains their speedup to the theoretical limits for the unstructured Grover's quantum search algorithm. In this paper, we show that quantum variational algorithms can efficiently optimise continuous multivariable functions by exploiting general structural properties of a discretised continuous solution space with a convergence that exceeds the limits of an unstructured quantum search. We introduce the Quantum Multivariable Optimisation Algorithm (QMOA) and demonstrate its advantage over pre-existing methods, particularly when optimising high-dimensional and oscillatory functions.
△ Less
Submitted 12 October, 2022;
originally announced October 2022.
-
Multiscale Graph Comparison via the Embedded Laplacian Discrepancy
Authors:
Edric Tam,
David Dunson
Abstract:
Laplacian eigenvectors capture natural community structures on graphs and are widely used in spectral clustering and manifold learning. The use of Laplacian eigenvectors as embeddings for the purpose of multiscale graph comparison has however been limited. Here we propose the Embedded Laplacian Discrepancy (ELD) as a simple and fast approach to compare graphs (of potentially different sizes) based…
▽ More
Laplacian eigenvectors capture natural community structures on graphs and are widely used in spectral clustering and manifold learning. The use of Laplacian eigenvectors as embeddings for the purpose of multiscale graph comparison has however been limited. Here we propose the Embedded Laplacian Discrepancy (ELD) as a simple and fast approach to compare graphs (of potentially different sizes) based on the similarity of the graphs' community structures. The ELD operates by representing graphs as point clouds in a common, low-dimensional space, on which a natural Wasserstein-based distance can be efficiently computed. A main challenge in comparing graphs through any eigenvector-based approaches is the potential ambiguity that could arise due to sign-flips and basis symmetries. The ELD leverages a simple symmetrization trick to bypass any sign ambiguities. For comparing graphs that do not have any ambiguities due to basis symmetries (i.e. the spectrums are simple), we show that the ELD becomes a natural pseudo-metric that enjoys nice properties such as invariance under graph isomorphism. For comparing graphs with non-simple spectrums, we propose a procedure to approximate the ELD via a simple perturbation technique to resolve any ambiguity from basis symmetries. We show that such perturbations are stable using matrix perturbation theory under mild assumptions that are straightforward to verify in practice. We demonstrate the excellent applicability of the ELD approach on both simulated and real datasets.
△ Less
Submitted 5 February, 2023; v1 submitted 28 January, 2022;
originally announced January 2022.
-
Effect of Adaptive and Fixed Shared Steering Control on Distracted Driver Behavior
Authors:
Zheng Wang,
Satoshi Suga,
Edric John Cruz Nacpil,
Bo Yang,
Kimihiko Nakano
Abstract:
Driver distraction is a well-known cause for traffic collisions worldwide. Studies have indicated that shared steering control, which actively provides haptic guidance torque on the steering wheel, effectively improves the performance of distracted drivers. Recently, adaptive shared steering control based on the physiological status of the driver has been developed, although its effect on distract…
▽ More
Driver distraction is a well-known cause for traffic collisions worldwide. Studies have indicated that shared steering control, which actively provides haptic guidance torque on the steering wheel, effectively improves the performance of distracted drivers. Recently, adaptive shared steering control based on the physiological status of the driver has been developed, although its effect on distracted driver behavior remains unclear. To this end, a high-fidelity driving simulator experiment was conducted involving 18 participants performing double lane changes. The experimental conditions comprised two driver states: attentive and distracted. Under each condition, evaluations were performed on three types of haptic guidance: none (manual), fixed authority, and adaptive authority based on feedback from the forearm surface electromyography of the driver. Evaluation results indicated that, for both attentive and distracted drivers, haptic guidance with adaptive authority yielded lower driver workload and reduced lane departure risk than manual driving and fixed authority. Moreover, there was a tendency for distracted drivers to reduce grip strength on the steering wheel to follow the haptic guidance with fixed authority, resulting in a relatively shorter double lane change duration.
△ Less
Submitted 7 June, 2021;
originally announced June 2021.
-
Modeling and analysis of driver behavior under shared control through weighted visual and haptic guidance
Authors:
Zheng Wang,
Rencheng Zheng,
Edric John Cruz Nacpil,
Kimihiko Nakano
Abstract:
For the optimum design of a driver-automation shared control system, an understanding of driver behavior based on measurements and modeling is crucial early in the development process. This paper presents a driver model through a weighting process of visual guidance from the road ahead and haptic guidance from a steering system for a lane-following task. The proposed weighting process describes th…
▽ More
For the optimum design of a driver-automation shared control system, an understanding of driver behavior based on measurements and modeling is crucial early in the development process. This paper presents a driver model through a weighting process of visual guidance from the road ahead and haptic guidance from a steering system for a lane-following task. The proposed weighting process describes the interaction of a driver with the haptic guidance steering and the driver reliance on it. A driving simulator experiment is conducted to identify the model parameters for driving manually and with haptic guidance. The proposed driver model matched the driver input torque with a satisfactory goodness of fit among fourteen participants after considering the individual differences. The validation results reveal that the simulated trajectory effectively followed the driving course by matching the measured trajectory, thereby indicating that the proposed driver model is capable of predicting driver behavior during haptic guidance. Furthermore, the effect of different degrees of driver reliance on driving performance is evaluated considering various driver states and with system failure via numerical analysis. The model evaluation results reveal the potential of the proposed driver model to be applied in the design and evaluation of a haptic guidance system.
△ Less
Submitted 7 October, 2020;
originally announced October 2020.
-
Adaptive driver-automation shared steering control via forearm surface electromyography measurement
Authors:
Zheng Wang,
Satoshi Suga,
Edric John Cruz Nacpil,
Zhanhong Yan,
Kimihiko Nakano
Abstract:
Shared steering control has been developed to reduce driver workload while keeping the driver in the control loop. A driver could integrate visual sensory information from the road ahead and haptic sensory information from the steering wheel to achieve better driving performance. Previous studies suggest that, compared with adaptive automation authority, fixed automation authority is not always ap…
▽ More
Shared steering control has been developed to reduce driver workload while keeping the driver in the control loop. A driver could integrate visual sensory information from the road ahead and haptic sensory information from the steering wheel to achieve better driving performance. Previous studies suggest that, compared with adaptive automation authority, fixed automation authority is not always appropriate with respect to human factors. This paper focuses on designing an adaptive shared steering control system via sEMG (surface electromyography) measurement from the forearm of the driver, and evaluates the effect of the system on driver behavior during a double lane change task. The shared steering control was achieved through a haptic guidance system which provided active assistance torque on the steering wheel. Ten subjects participated in a high-fidelity driving simulator experiment. Two types of adaptive algorithms were investigated: haptic guidance decreases when driver grip strength increases (HG-Decrease), and haptic guidance increases when driver grip strength increases (HG-Increase). These two algorithms were compared to manual driving and two levels of fixed authority haptic guidance, for a total of five experimental conditions. Evaluation of the driving systems was based on two sets of dependent variables: objective measures of driver behavior and subjective measures of driver workload. The results indicate that the adaptive authority of HG-Decrease yielded lower driver workload and reduced the lane departure risk compared to manual driving and fixed authority haptic guidance.
△ Less
Submitted 9 September, 2020;
originally announced September 2020.
-
Surface Electromyography-controlled Pedestrian Collision Avoidance: A Driving Simulator Study
Authors:
Edric John Cruz Nacpil,
Zheng Wang,
Zhanhong Yan,
Tsutomu Kaizuka,
Kimihiko Nakano
Abstract:
Drivers with disabilities such as hemiplegia or unilateral upper limb amputation restricting steering wheel operation to one arm could encounter the challenge of stabilizing vehicles during pedestrian collision avoidance. An sEMG-controlled steering assistance system was developed for these drivers to enable rapid steering wheel rotation with only one healthy arm. Test drivers were recruited to us…
▽ More
Drivers with disabilities such as hemiplegia or unilateral upper limb amputation restricting steering wheel operation to one arm could encounter the challenge of stabilizing vehicles during pedestrian collision avoidance. An sEMG-controlled steering assistance system was developed for these drivers to enable rapid steering wheel rotation with only one healthy arm. Test drivers were recruited to use the Myo armband as a sEMG-based interface to perform pedestrian collision avoidance in a driving simulator. It was hypothesized that the sEMG-based interface would be comparable or superior in vehicle stability to manual takeover from automated driving and conventional steering wheel operation. The Myo armband interface was significantly superior to manual takeover from automated driving and comparable to manual steering wheel operation. The results of the driving simulator trials confirm the feasibility of the sEMG-controlled system as a safe alternative that could benefit drivers with the aforesaid disabilities.
△ Less
Submitted 23 July, 2020;
originally announced July 2020.
-
QSW_MPI: a framework for parallel simulation of quantum stochastic walks
Authors:
Edric Matwiejew,
Jingbo Wang
Abstract:
QSW_MPI is a python package developed for time-series simulation of continuous-time quantum stochastic walks. This model allows for the study of Markovian open quantum systems in the Lindblad formalism, including a generalisation of the continuous-time random walk and continuous-time quantum walk. Consisting of a python interface accessing parallelised Fortran libraries utilising sparse data struc…
▽ More
QSW_MPI is a python package developed for time-series simulation of continuous-time quantum stochastic walks. This model allows for the study of Markovian open quantum systems in the Lindblad formalism, including a generalisation of the continuous-time random walk and continuous-time quantum walk. Consisting of a python interface accessing parallelised Fortran libraries utilising sparse data structures, QSW_MPI is scalable to massively parallel computers, which makes possible the simulation of a wide range of walk dynamics on directed and undirected graphs of arbitrary complexity.
△ Less
Submitted 8 July, 2020; v1 submitted 5 March, 2020;
originally announced March 2020.
-
Fiedler Regularization: Learning Neural Networks with Graph Sparsity
Authors:
Edric Tam,
David Dunson
Abstract:
We introduce a novel regularization approach for deep learning that incorporates and respects the underlying graphical structure of the neural network. Existing regularization methods often focus on dropping/penalizing weights in a global manner that ignores the connectivity structure of the neural network. We propose to use the Fiedler value of the neural network's underlying graph as a tool for…
▽ More
We introduce a novel regularization approach for deep learning that incorporates and respects the underlying graphical structure of the neural network. Existing regularization methods often focus on dropping/penalizing weights in a global manner that ignores the connectivity structure of the neural network. We propose to use the Fiedler value of the neural network's underlying graph as a tool for regularization. We provide theoretical support for this approach via spectral graph theory. We list several useful properties of the Fiedler value that makes it suitable in regularization. We provide an approximate, variational approach for fast computation in practical training of neural networks. We provide bounds on such approximations. We provide an alternative but equivalent formulation of this framework in the form of a structurally weighted L1 penalty, thus linking our approach to sparsity induction. We performed experiments on datasets that compare Fiedler regularization with traditional regularization methods such as dropout and weight decay. Results demonstrate the efficacy of Fiedler regularization.
△ Less
Submitted 15 August, 2020; v1 submitted 2 March, 2020;
originally announced March 2020.