Showing 1–24 of 24 results for author: Sang, P

Engagement and Disclosures in LLM-Powered Cognitive Behavioral Therapy Exercises: A Factorial Design Comparing the Influence of a Robot vs. Chatbot Over Time

Authors: Mina Kian, Mingyu Zong, Katrin Fischer, Anna-Maria Velentza, Abhyuday Singh, Kaleen Shrestha, Pau Sang, Shriya Upadhyay, Wallace Browning, Misha Arif Faruki, Sébastien M. R. Arnold, Bhaskar Krishnamachari, Maja Matarić

Abstract: Many researchers are working to address the worldwide mental health crisis by developing therapeutic technologies that increase the accessibility of care, including leveraging large language model (LLM) capabilities in chatbots and socially assistive robots (SARs) used for therapeutic applications. Yet, the effects of these technologies over time remain unexplored. In this study, we use a factoria… ▽ More Many researchers are working to address the worldwide mental health crisis by developing therapeutic technologies that increase the accessibility of care, including leveraging large language model (LLM) capabilities in chatbots and socially assistive robots (SARs) used for therapeutic applications. Yet, the effects of these technologies over time remain unexplored. In this study, we use a factorial design to assess the impact of embodiment and time spent engaging in therapeutic exercises on participant disclosures. We assessed transcripts gathered from a two-week study in which 26 university student participants completed daily interactive Cognitive Behavioral Therapy (CBT) exercises in their residences using either an LLM-powered SAR or a disembodied chatbot. We evaluated the levels of active engagement and high intimacy of their disclosures (opinions, judgments, and emotions) during each session and over time. Our findings show significant interactions between time and embodiment for both outcome measures: participant engagement and intimacy increased over time in the physical robot condition, while both measures decreased in the chatbot condition. △ Less

Submitted 21 June, 2025; originally announced June 2025.

Kernel-based Method for Detecting Structural Break in Distribution of Functional Data

Authors: Peijun Sang, Bing Li

Abstract: We propose a novel method to detect and date structural breaks in the entire distribution of functional data. Theoretical guarantees are developed for our procedure under fewer assumptions than in the existing work. In particular, we establish the asymptotic null distribution of the test statistic, which enables us to test the null hypothesis at a certain significance level. Additionally, the limi… ▽ More We propose a novel method to detect and date structural breaks in the entire distribution of functional data. Theoretical guarantees are developed for our procedure under fewer assumptions than in the existing work. In particular, we establish the asymptotic null distribution of the test statistic, which enables us to test the null hypothesis at a certain significance level. Additionally, the limiting distribution of the estimated structural break date is developed under two situations of the break size: fixed and shrinking towards 0 at a specified rate. We further propose a unified bootstrap procedure to construct a confidence interval for the true structural break date for these two situations. These theoretical results are justified through comprehensive simulation studies in finite samples. We apply the proposed method to two real-world examples: Australian temperature data for detecting structural beaks and Canadian weather data for goodness of fit. △ Less

Submitted 15 April, 2025; originally announced April 2025.

Determine the Order of Functional Data

Authors: Chi Zhang, Peijun Sang, Yingli Qin

Abstract: Dimension reduction is often necessary in functional data analysis, with functional principal component analysis being one of the most widely used techniques. A key challenge in applying these methods is determining the number of eigen-pairs to retain, a problem known as order determination. When a covariance function admits a finite representation, the challenge becomes estimating the rank of the… ▽ More Dimension reduction is often necessary in functional data analysis, with functional principal component analysis being one of the most widely used techniques. A key challenge in applying these methods is determining the number of eigen-pairs to retain, a problem known as order determination. When a covariance function admits a finite representation, the challenge becomes estimating the rank of the associated covariance operator. While this problem is straightforward when the full trajectories of functional data are available, in practice, functional data are typically collected discretely and are subject to measurement error contamination. This contamination introduces a ridge to the empirical covariance function, which obscures the true rank of the covariance operator. We propose a novel procedure to identify the true rank of the covariance operator by leveraging the information of eigenvalues and eigenfunctions. By incorporating the nonparametric nature of functional data through smoothing techniques, the method is applicable to functional data collected at random, subject-specific points. Extensive simulation studies demonstrate the excellent performance of our approach across a wide range of settings, outperforming commonly used information-criterion-based methods and maintaining effectiveness even in high-noise scenarios. We further illustrate our method with two real-world data examples. △ Less

Submitted 4 March, 2025; originally announced March 2025.

Likelihood-based Nonparametric Receiver Operating Characteristic Curve Analysis in the Presence of Imperfect Reference Standard

Authors: Yifan Sun, Peijun Sang, Qinglong Tian, Pengfei Li

Abstract: In diagnostic studies, researchers frequently encounter imperfect reference standards with some misclassified labels. Treating these as gold standards can bias receiver operating characteristic (ROC) curve analysis. To address this issue, we propose a novel likelihood-based method under a nonparametric density ratio model. This approach enables the reliable estimation of the ROC curve, area under… ▽ More In diagnostic studies, researchers frequently encounter imperfect reference standards with some misclassified labels. Treating these as gold standards can bias receiver operating characteristic (ROC) curve analysis. To address this issue, we propose a novel likelihood-based method under a nonparametric density ratio model. This approach enables the reliable estimation of the ROC curve, area under the curve (AUC), partial AUC, and Youden's index with favorable statistical properties. To implement the method, we develop an efficient expectation-maximization algorithm algorithm. Extensive simulations evaluate its finite-sample performance, showing smaller mean squared errors in estimating the ROC curve, partial AUC, and Youden's index compared to existing methods. We apply the proposed approach to a malaria study. △ Less

Submitted 12 February, 2025; originally announced February 2025.

Bootstrap Nonparametric Inference under Data Integration

Authors: Zuofeng Shang, Peijun Sang, Chong Jin

Abstract: We propose multiplier bootstrap procedures for nonparametric inference and uncertainty quantification of the target mean function, based on a novel framework of integrating target and source data. We begin with the relatively easier covariate shift scenario with equal target and source mean functions and propose estimation and inferential procedures through a straightforward combination of all tar… ▽ More We propose multiplier bootstrap procedures for nonparametric inference and uncertainty quantification of the target mean function, based on a novel framework of integrating target and source data. We begin with the relatively easier covariate shift scenario with equal target and source mean functions and propose estimation and inferential procedures through a straightforward combination of all target and source datasets. We next consider the more general and flexible distribution shift scenario with arbitrary target and source mean functions, and propose a two-step inferential procedure. First, we estimate the target-to-source differences based on separate portions of the target and source data. Second, the remaining source data are adjusted by these differences and combined with the remaining target data to perform the multiplier bootstrap procedure. Our method enables local and global inference on the target mean function without using asymptotic distributions. To justify our approach, we derive an optimal convergence rate for the nonparametric estimator and establish bootstrap consistency to estimate the asymptotic distribution of the nonparametric estimator. The proof of global bootstrap consistency involves a central limit theorem for quadratic forms with dependent variables under a conditional probability measure. Our method applies to arbitrary source and target datasets, provided that the data sizes meet a specific quantitative relationship. Simulation studies and real data analysis are provided to examine the performance of our approach. △ Less

Submitted 2 January, 2025; originally announced January 2025.

Comments: 29 pages, 5 figures

Circuit-Theoretic Joint Parameter-State Estimation of Utility-Scale Photovoltaic, Battery, and Grid Systems

Authors: Peng Sang, Amritanshu Pandey

Abstract: Solar PV and battery storage systems have become integral to modern power grids. Therefore, bulk grid models in real-time operation must include their physical behavior accurately for analysis and optimization. AC state estimation is critical to building real-time bulk power systems models. However, current ACSE techniques do not include detailed physics and measurements for battery and PV systems… ▽ More Solar PV and battery storage systems have become integral to modern power grids. Therefore, bulk grid models in real-time operation must include their physical behavior accurately for analysis and optimization. AC state estimation is critical to building real-time bulk power systems models. However, current ACSE techniques do not include detailed physics and measurements for battery and PV systems. This results in sub-optimal estimation results and subsequent less accurate bulk grid models for real-time operation. To address these challenges, we formulate a circuit-theoretic AC state estimator with accurate PV and battery systems physics and corresponding measurements. First, we propose an aggregated equivalent circuit model of the solar PV, battery, and traditional grid components. Next, we add measurements from PV and battery systems to the traditional measurement set to facilitate accurate estimation of the overall grid model. Finally, we develop a circuit-theoretic joint parameter-state estimation algorithm that can accurately estimate grid, PV, and battery system states and is robust against erroneous parameters. To demonstrate the efficacy of the proposed framework, we estimate the states of 10k node transmission networks with hundreds of battery+PV-tied systems. We compare the accuracy against the estimation of stand-alone grid, battery, and PV systems. △ Less

Submitted 16 December, 2024; originally announced December 2024.

Variational Nonparametric Inference in Functional Stochastic Block Model

Authors: Zuofeng Shang, Peijun Sang, Yang Feng, Chong Jin

Abstract: We propose a functional stochastic block model whose vertices involve functional data information. This new model extends the classic stochastic block model with vector-valued nodal information, and finds applications in real-world networks whose nodal information could be functional curves. Examples include international trade data in which a network vertex (country) is associated with the annual… ▽ More We propose a functional stochastic block model whose vertices involve functional data information. This new model extends the classic stochastic block model with vector-valued nodal information, and finds applications in real-world networks whose nodal information could be functional curves. Examples include international trade data in which a network vertex (country) is associated with the annual or quarterly GDP over certain time period, and MyFitnessPal data in which a network vertex (MyFitnessPal user) is associated with daily calorie information measured over certain time period. Two statistical tasks will be jointly executed. First, we will detect community structures of the network vertices assisted by the functional nodal information. Second, we propose computationally efficient variational test to examine the significance of the functional nodal information. We show that the community detection algorithms achieve weak and strong consistency, and the variational test is asymptotically chi-square with diverging degrees of freedom. As a byproduct, we propose pointwise confidence intervals for the slop function of the functional nodal information. Our methods are examined through both simulated and real datasets. △ Less

Submitted 29 June, 2024; originally announced July 2024.

Circuit-theoretic Joint Parameter-State Estimation -- Balancing Optimality and AC Feasibility

Authors: Peng Sang, Amritanshu Pandey

Abstract: AC State Estimation (ACSE) is widely recognized as a practical approach for determining the grid states in steady-state conditions. It serves as a fundamental analysis to ensure grid security and is a reference for market dispatch. As grid complexity increases with rapid electrification and decarbonization, there is a growing need for more accurate knowledge of the grid operating state. However, e… ▽ More AC State Estimation (ACSE) is widely recognized as a practical approach for determining the grid states in steady-state conditions. It serves as a fundamental analysis to ensure grid security and is a reference for market dispatch. As grid complexity increases with rapid electrification and decarbonization, there is a growing need for more accurate knowledge of the grid operating state. However, existing ACSE algorithms have technical gaps. Critically, current ACSE algorithms are susceptible to erroneous system parameters, which are assumed to be fixed in traditional approaches. In this paper, we build a novel circuit-theoretic joint parameter-state estimation algorithm to address this limitation. The innovative algorithm builds an analogous equivalent circuit of the grid with states and certain parameters unknown. It solves a circuit-constrained optimization to estimate the most likely grid states and parameters given a set of measurements. Further, it quantifies the goodness of the estimated output by formulating tight convex envelopes around the original non-convex problem to quantify the quality of estimates. We compare the various proposed approaches on systems with up to 2869 nodes while demonstrating a tradeoff between solution optimality and model fidelity. △ Less

Submitted 10 June, 2025; v1 submitted 16 April, 2024; originally announced April 2024.

Comments: To be presented at XXIII Power Systems Computation Conference

Can an LLM-Powered Socially Assistive Robot Effectively and Safely Deliver Cognitive Behavioral Therapy? A Study With University Students

Authors: Mina J. Kian, Mingyu Zong, Katrin Fischer, Abhyuday Singh, Anna-Maria Velentza, Pau Sang, Shriya Upadhyay, Anika Gupta, Misha A. Faruki, Wallace Browning, Sebastien M. R. Arnold, Bhaskar Krishnamachari, Maja J. Mataric

Abstract: Cognitive behavioral therapy (CBT) is a widely used therapeutic method for guiding individuals toward restructuring their thinking patterns as a means of addressing anxiety, depression, and other challenges. We developed a large language model (LLM)-powered prompt-engineered socially assistive robot (SAR) that guides participants through interactive CBT at-home exercises. We evaluated the performa… ▽ More Cognitive behavioral therapy (CBT) is a widely used therapeutic method for guiding individuals toward restructuring their thinking patterns as a means of addressing anxiety, depression, and other challenges. We developed a large language model (LLM)-powered prompt-engineered socially assistive robot (SAR) that guides participants through interactive CBT at-home exercises. We evaluated the performance of the SAR through a 15-day study with 38 university students randomly assigned to interact daily with the robot or a chatbot (using the same LLM), or complete traditional CBT worksheets throughout the duration of the study. We measured weekly therapeutic outcomes, changes in pre-/post-session anxiety measures, and adherence to completing CBT exercises. We found that self-reported measures of general psychological distress significantly decreased over the study period in the robot and worksheet conditions but not the chatbot condition. Furthermore, the SAR enabled significant single-session improvements for more sessions than the other two conditions combined. Our findings suggest that SAR-guided LLM-powered CBT may be as effective as traditional worksheet methods in supporting therapeutic progress from the beginning to the end of the study and superior in decreasing user anxiety immediately after completing the CBT exercise. △ Less

Submitted 27 February, 2024; originally announced February 2024.

Two-sample inference for sparse functional data

Authors: Chi Zhang, Peijun Sang, Yingli Qin

Abstract: We propose a novel test procedure for comparing mean functions across two groups within the reproducing kernel Hilbert space (RKHS) framework. Our proposed method is adept at handling sparsely and irregularly sampled functional data when observation times are random for each subject. Conventional approaches, which are built upon functional principal components analysis, usually assume a homogeneou… ▽ More We propose a novel test procedure for comparing mean functions across two groups within the reproducing kernel Hilbert space (RKHS) framework. Our proposed method is adept at handling sparsely and irregularly sampled functional data when observation times are random for each subject. Conventional approaches, which are built upon functional principal components analysis, usually assume a homogeneous covariance structure across groups. Nonetheless, justifying this assumption in real-world scenarios can be challenging. To eliminate the need for a homogeneous covariance structure, we first develop a linear approximation for the mean estimator under the RKHS framework; this approximation is a sum of i.i.d. random elements, which naturally leads to the desirable pointwise limiting distributions. Moreover, we establish weak convergence for the mean estimator, allowing us to construct a test statistic for the mean difference. Our method is easily implementable and outperforms some conventional tests in controlling type I errors across various settings. We demonstrate the finite sample performance of our approach through extensive simulations and two real-world applications. △ Less

Submitted 28 January, 2025; v1 submitted 12 December, 2023; originally announced December 2023.

Restricted Tweedie Stochastic Block Models

Authors: Jie Jian, Mu Zhu, Peijun Sang

Abstract: The stochastic block model (SBM) is a widely used framework for community detection in networks, where the network structure is typically represented by an adjacency matrix. However, conventional SBMs are not directly applicable to an adjacency matrix that consists of non-negative zero-inflated continuous edge weights. To model the international trading network, where edge weights represent tradin… ▽ More The stochastic block model (SBM) is a widely used framework for community detection in networks, where the network structure is typically represented by an adjacency matrix. However, conventional SBMs are not directly applicable to an adjacency matrix that consists of non-negative zero-inflated continuous edge weights. To model the international trading network, where edge weights represent trading values between countries, we propose an innovative SBM based on a restricted Tweedie distribution. Additionally, we incorporate nodal information, such as the geographical distance between countries, and account for its dynamic effect on edge weights. Notably, we show that given a sufficiently large number of nodes, estimating this covariate effect becomes independent of community labels of each node when computing the maximum likelihood estimator of parameters in our model. This result enables the development of an efficient two-step algorithm that separates the estimation of covariate effects from other parameters. We demonstrate the effectiveness of our proposed method through extensive simulation studies and an application to real-world international trading data. △ Less

Submitted 16 October, 2023; originally announced October 2023.

A Bayesian Collocation Integral Method for Parameter Estimation in Ordinary Differential Equations

Authors: Mingwei Xu, Samuel W. K. Wong, Peijun Sang

Abstract: Inferring the parameters of ordinary differential equations (ODEs) from noisy observations is an important problem in many scientific fields. Currently, most parameter estimation methods that bypass numerical integration tend to rely on basis functions or Gaussian processes to approximate the ODE solution and its derivatives. Due to the sensitivity of the ODE solution to its derivatives, these met… ▽ More Inferring the parameters of ordinary differential equations (ODEs) from noisy observations is an important problem in many scientific fields. Currently, most parameter estimation methods that bypass numerical integration tend to rely on basis functions or Gaussian processes to approximate the ODE solution and its derivatives. Due to the sensitivity of the ODE solution to its derivatives, these methods can be hindered by estimation error, especially when only sparse time-course observations are available. We present a Bayesian collocation framework that operates on the integrated form of the ODEs and also avoids the expensive use of numerical solvers. Our methodology has the capability to handle general nonlinear ODE systems. We demonstrate the accuracy of the proposed method through simulation studies, where the estimated parameters and recovered system trajectories are compared with other recent methods. A real data example is also provided. △ Less

Submitted 23 October, 2023; v1 submitted 4 April, 2023; originally announced April 2023.

Scalable inference in functional linear regression with streaming data

Authors: Jinhan Xie, Enze Shi, Peijun Sang, Zuofeng Shang, Bei Jiang, Linglong Kong

Abstract: Traditional static functional data analysis is facing new challenges due to streaming data, where data constantly flow in. A major challenge is that storing such an ever-increasing amount of data in memory is nearly impossible. In addition, existing inferential tools in online learning are mainly developed for finite-dimensional problems, while inference methods for functional data are focused on… ▽ More Traditional static functional data analysis is facing new challenges due to streaming data, where data constantly flow in. A major challenge is that storing such an ever-increasing amount of data in memory is nearly impossible. In addition, existing inferential tools in online learning are mainly developed for finite-dimensional problems, while inference methods for functional data are focused on the batch learning setting. In this paper, we tackle these issues by developing functional stochastic gradient descent algorithms and proposing an online bootstrap resampling procedure to systematically study the inference problem for functional linear regression. In particular, the proposed estimation and inference procedures use only one pass over the data; thus they are easy to implement and suitable to the situation where data arrive in a streaming manner. Furthermore, we establish the convergence rate as well as the asymptotic distribution of the proposed estimator. Meanwhile, the proposed perturbed estimator from the bootstrap procedure is shown to enjoy the same theoretical properties, which provide the theoretical justification for our online inference tool. As far as we know, this is the first inference result on the functional linear regression model with streaming data. Simulation studies are conducted to investigate the finite-sample performance of the proposed procedure. An application is illustrated with the Beijing multi-site air-quality data. △ Less

Submitted 10 October, 2023; v1 submitted 5 February, 2023; originally announced February 2023.

Comments: Due to the request of one of the co-authors, we tentatively withdrew the manuscript

Order Statistics Approaches to Unobserved Heterogeneity in Auctions

Authors: Yao Luo, Peijun Sang, Ruli Xiao

Abstract: We establish nonparametric identification of auction models with continuous and nonseparable unobserved heterogeneity using three consecutive order statistics of bids. We then propose sieve maximum likelihood estimators for the joint distribution of unobserved heterogeneity and the private value, as well as their conditional and marginal distributions. Lastly, we apply our methodology to a novel d… ▽ More We establish nonparametric identification of auction models with continuous and nonseparable unobserved heterogeneity using three consecutive order statistics of bids. We then propose sieve maximum likelihood estimators for the joint distribution of unobserved heterogeneity and the private value, as well as their conditional and marginal distributions. Lastly, we apply our methodology to a novel dataset from judicial auctions in China. Our estimates suggest substantial gains from accounting for unobserved heterogeneity when setting reserve prices. We propose a simple scheme that achieves nearly optimal revenue by using the appraisal value as the reserve price. △ Less

Submitted 7 October, 2022; originally announced October 2022.

Optimality conditions and Lipschitz stability for non-smooth semilinear elliptic optimal control problems with sparse controls

Authors: Vu Huu Nhu, Phan Quang Sang

Abstract: This paper is concerned with first- and second-order optimality conditions as well as the stability for non-smooth semilinear optimal control problems involving the $L^1$-norm of the control in the cost functional. In addition to the appearance of the $L^1$-norm leading to the non-differentiability of the objective and promoting the sparsity of the optimal controls, the non-smoothness of the non… ▽ More This paper is concerned with first- and second-order optimality conditions as well as the stability for non-smooth semilinear optimal control problems involving the $L^1$-norm of the control in the cost functional. In addition to the appearance of the $L^1$-norm leading to the non-differentiability of the objective and promoting the sparsity of the optimal controls, the non-smoothness of the nonlinear coefficient in the state equation causes the same property of the control-to-state operator. Exploiting a regularization scheme, we derive $C$-stationarity conditions for any local optimal control. Under a structural assumption on the associated state, we define the curvature functional for the part not including the $L^1$-norm of controls of the objective for which the second-order necessary and sufficient optimality conditions are shown. Furthermore, under a more restrictive structural assumption imposed on the mentioned state, an explicit formulation of the curvature is established and thus the explicit second-order optimality conditions are stated. Finally, the Lipschitz stability of local solutions with respect to the sparsity parameter is shown. △ Less

Submitted 16 October, 2023; v1 submitted 9 September, 2022; originally announced September 2022.

MSC Class: 49K20; 49J20; 35J25; 35J61; 35J91; 90C48

Nonlinear function-on-function regression by RKHS

Authors: Peijun Sang, Bing Li

Abstract: We propose a nonlinear function-on-function regression model where both the covariate and the response are random functions. The nonlinear regression is carried out in two steps: we first construct Hilbert spaces to accommodate the functional covariate and the functional response, and then build a second-layer Hilbert space for the covariate to capture nonlinearity. The second-layer space is assum… ▽ More We propose a nonlinear function-on-function regression model where both the covariate and the response are random functions. The nonlinear regression is carried out in two steps: we first construct Hilbert spaces to accommodate the functional covariate and the functional response, and then build a second-layer Hilbert space for the covariate to capture nonlinearity. The second-layer space is assumed to be a reproducing kernel Hilbert space, which is generated by a positive definite kernel determined by the inner product of the first-layer Hilbert space for $X$--this structure is known as the nested Hilbert spaces. We develop estimation procedures to implement the proposed method, which allows the functional data to be observed at different time points for different subjects. Furthermore, we establish the convergence rate of our estimator as well as the weak convergence of the predicted response in the Hilbert space. Numerical studies including both simulations and a data application are conducted to investigate the performance of our estimator in finite sample. △ Less

Submitted 17 July, 2022; originally announced July 2022.

Efficient Estimation of Structural Models via Sieves

Authors: Yao Luo, Peijun Sang

Abstract: We propose a class of sieve-based efficient estimators for structural models (SEES), which approximate the solution using a linear combination of basis functions and impose equilibrium conditions as a penalty to determine the best-fitting coefficients. Our estimators avoid the need to repeatedly solve the model, apply to a broad class of models, and are consistent, asymptotically normal, and asymp… ▽ More We propose a class of sieve-based efficient estimators for structural models (SEES), which approximate the solution using a linear combination of basis functions and impose equilibrium conditions as a penalty to determine the best-fitting coefficients. Our estimators avoid the need to repeatedly solve the model, apply to a broad class of models, and are consistent, asymptotically normal, and asymptotically efficient. Moreover, they solve unconstrained optimization problems with fewer unknowns and offer convenient standard error calculations. As an illustration, we apply our method to an entry game between Walmart and Kmart. △ Less

Submitted 23 February, 2025; v1 submitted 28 April, 2022; originally announced April 2022.

Stopping time detection of wood panel compression: A functional time series approach

Authors: H. L. Shang, J. Cao, P. Sang

Abstract: We consider determining the optimal stopping time for the glue curing of wood panels in an automatic process environment. Using the near-infrared spectroscopy technology to monitor the manufacturing process ensures substantial savings in energy and time. We collect a time series of curves from a near-infrared spectrum probe consisting of 72 spectra and aim to detect an optimal stopping time. We pr… ▽ More We consider determining the optimal stopping time for the glue curing of wood panels in an automatic process environment. Using the near-infrared spectroscopy technology to monitor the manufacturing process ensures substantial savings in energy and time. We collect a time series of curves from a near-infrared spectrum probe consisting of 72 spectra and aim to detect an optimal stopping time. We propose an estimation procedure to determine the optimal stopping time of wood panel compression and the estimation uncertainty associated with the estimated stopping time. Our method first divides the entire data set into a training sample and a testing sample, then iteratively computes integrated squared forecast errors based on the testing sample. We then apply a structural break detection method with one breakpoint to determine an estimated optimal stopping time from a univariate time series of the integrated squared forecast errors. We also investigate the finite-sample performance of the proposed method via a series of simulation studies. △ Less

Submitted 27 April, 2022; originally announced April 2022.

Comments: 24 pages, 5 figures, to appear at the Journal of the Royal Statistical Society: Series C

MSC Class: 62R10

Functional principal component analysis with informative observation times

Authors: Peijun Sang, Dehan Kong, Shu Yang

Abstract: Functional principal component analysis has been shown to be invaluable for revealing variation modes of longitudinal outcomes, which serves as important building blocks for forecasting and model building. Decades of research have advanced methods for functional principal component analysis often assuming independence between the observation times and longitudinal outcomes. Yet such assumptions ar… ▽ More Functional principal component analysis has been shown to be invaluable for revealing variation modes of longitudinal outcomes, which serves as important building blocks for forecasting and model building. Decades of research have advanced methods for functional principal component analysis often assuming independence between the observation times and longitudinal outcomes. Yet such assumptions are fragile in real-world settings where observation times may be driven by outcome-related reasons. Rather than ignoring the informative observation time process, we explicitly model the observational times by a counting process dependent on time-varying prognostic factors. Identification of the mean, covariance function, and functional principal components ensues via inverse intensity weighting. We propose using weighted penalized splines for estimation and establish consistency and convergence rates for the weighted estimators. Simulation studies demonstrate that the proposed estimators are substantially more accurate than the existing ones in the presence of a correlation between the observation time process and the longitudinal outcome process. We further examine the finite-sample performance of the proposed method using the Acute Infection and Early Disease Research Program study. △ Less

Submitted 3 October, 2024; v1 submitted 28 March, 2022; originally announced March 2022.

Statistical Inference for Functional Linear Quantile Regression

Authors: Peijun Sang, Zuofeng Shang, Pang Du

Abstract: We propose inferential tools for functional linear quantile regression where the conditional quantile of a scalar response is assumed to be a linear functional of a functional covariate. In contrast to conventional approaches, we employ kernel convolution to smooth the original loss function. The coefficient function is estimated under a reproducing kernel Hilbert space framework. A gradient desce… ▽ More We propose inferential tools for functional linear quantile regression where the conditional quantile of a scalar response is assumed to be a linear functional of a functional covariate. In contrast to conventional approaches, we employ kernel convolution to smooth the original loss function. The coefficient function is estimated under a reproducing kernel Hilbert space framework. A gradient descent algorithm is designed to minimize the smoothed loss function with a roughness penalty. With the aid of the Banach fixed-point theorem, we show the existence and uniqueness of our proposed estimator as the minimizer of the regularized loss function in an appropriate Hilbert space. Furthermore, we establish the convergence rate as well as the weak convergence of our estimator. As far as we know, this is the first weak convergence result for a functional quantile regression model. Pointwise confidence intervals and a simultaneous confidence band for the true coefficient function are then developed based on these theoretical properties. Numerical studies including both simulations and a data application are conducted to investigate the performance of our estimator and inference tools in finite sample. △ Less

Submitted 23 February, 2022; originally announced February 2022.

Two Gaussian regularization methods for time-varying networks

Authors: Jie Jian, Peijun Sang, Mu Zhu

Abstract: We model time-varying network data as realizations from multivariate Gaussian distributions with precision matrices that change over time. To facilitate parameter estimation, we require not only that each precision matrix at any given time point be sparse, but also that precision matrices at neighboring time points be similar. We accomplish this with two different algorithms, by generalizing the e… ▽ More We model time-varying network data as realizations from multivariate Gaussian distributions with precision matrices that change over time. To facilitate parameter estimation, we require not only that each precision matrix at any given time point be sparse, but also that precision matrices at neighboring time points be similar. We accomplish this with two different algorithms, by generalizing the elastic net and the fused LASSO, respectively. Our main focuses are efficient computational algorithms and convenient degree-of-freedom formulae for choosing tuning parameters. We illustrate our methods with two simulation studies. By applying them to an fMRI data set, we also detect some interesting differences in brain connectivity between healthy individuals and ADHD patients. △ Less

Submitted 9 March, 2022; v1 submitted 14 February, 2022; originally announced February 2022.

A reproducing kernel Hilbert space framework for functional data classification

Authors: Peijun Sang, Adam B Kashlak, Linglong Kong

Abstract: We encounter a bottleneck when we try to borrow the strength of classical classifiers to classify functional data. The major issue is that functional data are intrinsically infinite dimensional, thus classical classifiers cannot be applied directly or have poor performance due to the curse of dimensionality. To address this concern, we propose to project functional data onto one specific direction… ▽ More We encounter a bottleneck when we try to borrow the strength of classical classifiers to classify functional data. The major issue is that functional data are intrinsically infinite dimensional, thus classical classifiers cannot be applied directly or have poor performance due to the curse of dimensionality. To address this concern, we propose to project functional data onto one specific direction, and then a distance-weighted discrimination DWD classifier is built upon the projection score. The projection direction is identified through minimizing an empirical risk function that contains the particular loss function in a DWD classifier, over a reproducing kernel Hilbert space. Hence our proposed classifier can avoid overfitting and enjoy appealing properties of DWD classifiers. This framework is further extended to accommodate functional data classification problems where scalar covariates are involved. In contrast to previous work, we establish a non-asymptotic estimation error bound on the relative misclassification rate. In finite sample case, we demonstrate that the proposed classifiers compare favorably with some commonly used functional classifiers in terms of prediction accuracy through simulation studies and a real-world application. △ Less

Submitted 7 March, 2021; originally announced March 2021.

Continuum centroid classifier for functional data

Authors: Zhiyang Zhou, Peijun Sang

Abstract: Aiming at the binary classification of functional data, we propose the continuum centroid classifier (CCC) built upon projections of functional data onto one specific direction. This direction is obtained via bridging the regression and classification. Controlling the extent of supervision, our technique is neither unsupervised nor fully supervised. Thanks to the intrinsic infinite dimension of fu… ▽ More Aiming at the binary classification of functional data, we propose the continuum centroid classifier (CCC) built upon projections of functional data onto one specific direction. This direction is obtained via bridging the regression and classification. Controlling the extent of supervision, our technique is neither unsupervised nor fully supervised. Thanks to the intrinsic infinite dimension of functional data, one of two subtypes of CCC enjoys the (asymptotic) zero misclassification rate. Our proposal includes an effective algorithm that yields a consistent empirical counterpart of CCC. Simulation studies demonstrate the performance of CCC in different scenarios. Finally, we apply CCC to two real examples. △ Less

Submitted 11 February, 2021; originally announced February 2021.

Comments: 38 pages, 4 figures, 2 tables

MSC Class: 62G08; 62H30

Density dependencies of interaction strengths and their influence on nuclear matter and neutron star in relativistic mean field theory

Authors: S. F. Ban, J. Li, S. Q. Zhang, H. Y. Jia, J. P. Sang, J. Meng

Abstract: The density dependencies of various effective interaction strengths in the relativistic mean field are studied and carefully compared for nuclear matter and neutron stars. The influences of different density dependencies are presented and discussed on mean field potentials, saturation properties for nuclear matter, equations of state, maximum masses and corresponding radii for neutron stars. Tho… ▽ More The density dependencies of various effective interaction strengths in the relativistic mean field are studied and carefully compared for nuclear matter and neutron stars. The influences of different density dependencies are presented and discussed on mean field potentials, saturation properties for nuclear matter, equations of state, maximum masses and corresponding radii for neutron stars. Though the interaction strengths and the potentials given by various interactions are quite different in nuclear matter, the differences of saturation properties are subtle, except for NL2 and TM2, which are mainly used for light nuclei, while the properties by various interactions for pure neutron matter are quite different. To get an equation of state for neutron matter without any ambiguity, it is necessary to constrain the effective interactions either by microscopic many-body calculations for the neutron matter data or the data of nuclei with extreme isospin. For neutron stars, the interaction with large interaction strengths give strong potentials and large Oppenheimer-Volkoff (OV) mass limits. The density-dependent interactions DD-ME1 and TW-99 favor a large neutron population due to their weak $ρ$-meson field at high densities. The OV mass limits calculated from different equations of state are 2.02 $\sim$ 2.81$ M_\odot$, and the corresponding radii are 10.78 $\sim$ 13.27 km. After the inclusion of the hyperons, the corresponding values become 1.52 $\sim$ 2.06 $M_\odot$ and 10.24 $\sim$ 11.38 km. △ Less

Submitted 12 February, 2004; originally announced February 2004.

Comments: 28 pages, 10 figures

Journal ref: Phys.Rev. C69 (2004) 045805