-
On the Symmetry of Limiting Distributions of M-estimators
Authors:
Arunav Bhowmick,
Arun Kumar Kuchibhotla
Abstract:
Many functionals of interest in statistics and machine learning can be written as minimizers of expected loss functions. Such functionals are called $M$-estimands, and can be estimated by $M$-estimators -- minimizers of empirical average losses. Traditionally, statistical inference (e.g., hypothesis tests and confidence sets) for $M$-estimands is obtained by proving asymptotic normality of $M$-est…
▽ More
Many functionals of interest in statistics and machine learning can be written as minimizers of expected loss functions. Such functionals are called $M$-estimands, and can be estimated by $M$-estimators -- minimizers of empirical average losses. Traditionally, statistical inference (e.g., hypothesis tests and confidence sets) for $M$-estimands is obtained by proving asymptotic normality of $M$-estimators centered at the target. However, asymptotic normality is only one of several possible limiting distributions and (asymptotically) valid inference becomes significantly difficult with non-normal limits. In this paper, we provide conditions for the symmetry of three general classes of limiting distributions, enabling inference using HulC (Kuchibhotla et al. (2024)).
△ Less
Submitted 25 November, 2024;
originally announced November 2024.
-
A New Method to Determine the Presence of Continuous Variation in Parameters of Biological Growth Curve Models
Authors:
Md Aktar Ul Karim,
Supriya Ramdas Bhagat,
Amiya Ranjan Bhowmick
Abstract:
Quantitative assessment of the growth of biological organisms has produced many mathematical equations. Many efforts have been given on statistical identification of the correct growth model from experimental data. Every growth equation is unique in terms of mathematical structures; however, one model may serve as a close approximation of the other by appropriate choice of the parameter(s). It is…
▽ More
Quantitative assessment of the growth of biological organisms has produced many mathematical equations. Many efforts have been given on statistical identification of the correct growth model from experimental data. Every growth equation is unique in terms of mathematical structures; however, one model may serve as a close approximation of the other by appropriate choice of the parameter(s). It is still a challenging problem to select the best estimating model from a set of model equations whose shapes are similar in nature. Our aim in this manuscript is to develop methodology that will reduce the efforts in model selection. This is achieved by utilizing an existing model selection criterion in an innovative way that reduces the number of model fitting exercises substantially. In this manuscript, we have shown that one model can be obtained from the other by choosing a suitable continuous transformation of the parameters. This idea builds an interconnection between many equations which are scattered in the literature. We also get several new growth equations; out of them large number of equations can be obtained from a few key models. Given a set of training data points and the key models, we utilize the idea of interval specific rate parameter (ISRP) proposed by Bhowmick et al (2014) to obtain a suitable mathematical model for the data. The ISRP profile of the parameters of simpler models indicates the nature of variation in parameters with time, thus, enable the experimenter to extrapolate the inference to more complex models. Our proposed methodology significantly reduces the efforts involved in model fitting exercises. The proposed idea is verified by using simulated and real data sets. In addition, theoretical justifications have been provided by investigating the statistical properties of the estimators.
△ Less
Submitted 16 February, 2021;
originally announced February 2021.
-
Protection Against Reconstruction and Its Applications in Private Federated Learning
Authors:
Abhishek Bhowmick,
John Duchi,
Julien Freudiger,
Gaurav Kapoor,
Ryan Rogers
Abstract:
In large-scale statistical learning, data collection and model fitting are moving increasingly toward peripheral devices---phones, watches, fitness trackers---away from centralized data collection. Concomitant with this rise in decentralized data are increasing challenges of maintaining privacy while allowing enough information to fit accurate, useful statistical models. This motivates local notio…
▽ More
In large-scale statistical learning, data collection and model fitting are moving increasingly toward peripheral devices---phones, watches, fitness trackers---away from centralized data collection. Concomitant with this rise in decentralized data are increasing challenges of maintaining privacy while allowing enough information to fit accurate, useful statistical models. This motivates local notions of privacy---most significantly, local differential privacy, which provides strong protections against sensitive data disclosures---where data is obfuscated before a statistician or learner can even observe it, providing strong protections to individuals' data. Yet local privacy as traditionally employed may prove too stringent for practical use, especially in modern high-dimensional statistical and machine learning problems. Consequently, we revisit the types of disclosures and adversaries against which we provide protections, considering adversaries with limited prior information and ensuring that with high probability, ensuring they cannot reconstruct an individual's data within useful tolerances. By reconceptualizing these protections, we allow more useful data release---large privacy parameters in local differential privacy---and we design new (minimax) optimal locally differentially private mechanisms for statistical learning problems for \emph{all} privacy levels. We thus present practicable approaches to large-scale locally private model training that were previously impossible, showing theoretically and empirically that we can fit large-scale image classification and language models with little degradation in utility.
△ Less
Submitted 3 June, 2019; v1 submitted 3 December, 2018;
originally announced December 2018.
