-
SILENT: A New Lens on Statistics in Software Timing Side Channels
Authors:
Martin Dunsche,
Patrick Bastian,
Marcel Maehren,
Nurullah Erinola,
Robert Merget,
Nicolai Bissantz,
Holger Dette,
Jörg Schwenk
Abstract:
Cryptographic research takes software timing side channels seriously. Approaches to mitigate them include constant-time coding and techniques to enforce such practices. However, recent attacks like Meltdown [42], Spectre [37], and Hertzbleed [70] have challenged our understanding of what it means for code to execute in constant time on modern CPUs. To ensure that assumptions on the underlying hard…
▽ More
Cryptographic research takes software timing side channels seriously. Approaches to mitigate them include constant-time coding and techniques to enforce such practices. However, recent attacks like Meltdown [42], Spectre [37], and Hertzbleed [70] have challenged our understanding of what it means for code to execute in constant time on modern CPUs. To ensure that assumptions on the underlying hardware are correct and to create a complete feedback loop, developers should also perform \emph{timing measurements} as a final validation step to ensure the absence of exploitable side channels. Unfortunately, as highlighted by a recent study by Jancar et al. [30], developers often avoid measurements due to the perceived unreliability of the statistical analysis and its guarantees.
In this work, we combat the view that statistical techniques only provide weak guarantees by introducing a new algorithm for the analysis of timing measurements with strong, formal statistical guarantees, giving developers a reliable analysis tool. Specifically, our algorithm (1) is non-parametric, making minimal assumptions about the underlying distribution and thus overcoming limitations of classical tests like the t-test, (2) handles unknown data dependencies in measurements, (3) can estimate in advance how many samples are needed to detect a leak of a given size, and (4) allows the definition of a negligible leak threshold $Δ$, ensuring that acceptable non-exploitable leaks do not trigger false positives, without compromising statistical soundness. We demonstrate the necessity, effectiveness, and benefits of our approach on both synthetic benchmarks and real-world applications.
△ Less
Submitted 28 April, 2025;
originally announced April 2025.
-
Detecting relevant dependencies under measurement error with applications to the analysis of planetary system evolution
Authors:
Patrick Bastian,
Nicolai Bissantz
Abstract:
Exoplanets play an important role in understanding the mechanics of planetary system formation and orbital evolution. In this context the correlations of different parameters of the planets and their host star are useful guides in the search for explanatory mechanisms. Based on a reanalysis of the data set from \cite{figueria14} we study the as of now still poorly understood correlation between pl…
▽ More
Exoplanets play an important role in understanding the mechanics of planetary system formation and orbital evolution. In this context the correlations of different parameters of the planets and their host star are useful guides in the search for explanatory mechanisms. Based on a reanalysis of the data set from \cite{figueria14} we study the as of now still poorly understood correlation between planetary surface gravity and stellar activity of Hot Jupiters. Unfortunately, data collection often suffers from measurement errors due to complicated and indirect measurement setups, rendering standard inference techniques unreliable.
We present new methods to estimate and test for correlations in a deconvolution framework and thereby improve the state of the art analysis of the data in two directions. First, we are now able to account for additive measurement errors which facilitates reliable inference. Second we test for relevant changes, i.e. we are testing for correlations exceeding a certain threshold $Δ$. This reflects the fact that small nonzero correlations are to be expected for real life data almost always and that standard statistical tests will therefore always reject the null of no correlation given sufficient data. Our theory focuses on quantities that can be estimated by U-Statistics which contain a variety of correlation measures. We propose a bootstrap test and establish its theoretical validity. As a by product we also obtain confidence intervals. Applying our methods to the Hot Jupiter data set from \cite{figueria14}, we observe that taking into account the measurement errors yields smaller point estimates and the null of no relevant correlation is rejected only for very small $Δ$. This demonstrates the importance of considering the impact of measurement errors to avoid misleading conclusions from the resulting statistical analysis.
△ Less
Submitted 7 April, 2025;
originally announced April 2025.
-
Simultaneous inference for Berkson errors-in-variables regression under fixed design
Authors:
Katharina Proksch,
Nicolai Bissantz,
Hajo Holzmann
Abstract:
In various applications of regression analysis, in addition to errors in the dependent observations also errors in the predictor variables play a substantial role and need to be incorporated in the statistical modeling process. In this paper we consider a nonparametric measurement error model of Berkson type with fixed design regressors and centered random errors, which is in contrast to much exis…
▽ More
In various applications of regression analysis, in addition to errors in the dependent observations also errors in the predictor variables play a substantial role and need to be incorporated in the statistical modeling process. In this paper we consider a nonparametric measurement error model of Berkson type with fixed design regressors and centered random errors, which is in contrast to much existing work in which the predictors are taken as random observations with random noise. Based on an estimator that takes the error in the predictor into account and on a suitable Gaussian approximation, we derive %uniform confidence statements for the function of interest. In particular, we provide finite sample bounds on the coverage error of uniform confidence bands, where we circumvent the use of extreme-value theory and rather rely on recent results on anti-concentration of Gaussian processes. In a simulation study we investigate the performance of the uniform confidence sets for finite samples.
△ Less
Submitted 2 September, 2020;
originally announced September 2020.
-
Goodness-of-fit testing the error distribution in multivariate indirect regression
Authors:
Justin Chown,
Nicolai Bissantz,
Holger Dette
Abstract:
We propose a goodness-of-fit test for the distribution of errors from a multivariate indirect regression model. The test statistic is based on the Khmaladze transformation of the empirical process of standardized residuals. This goodness-of-fit test is consistent at the root-n rate of convergence, and the test can maintain power against local alternatives converging to the null at a root-n rate.
We propose a goodness-of-fit test for the distribution of errors from a multivariate indirect regression model. The test statistic is based on the Khmaladze transformation of the empirical process of standardized residuals. This goodness-of-fit test is consistent at the root-n rate of convergence, and the test can maintain power against local alternatives converging to the null at a root-n rate.
△ Less
Submitted 6 December, 2018;
originally announced December 2018.
-
Multiscale inference for multivariate deconvolution
Authors:
Konstantin Eckle,
Nicolai Bissantz,
Holger Dette
Abstract:
In this paper we provide new methodology for inference of the geometric features of a multivariate density in deconvolution. Our approach is based on multiscale tests to detect significant directional derivatives of the unknown density at arbitrary points in arbitrary directions. The multiscale method is used to identify regions of monotonicity and to construct a general procedure for the detectio…
▽ More
In this paper we provide new methodology for inference of the geometric features of a multivariate density in deconvolution. Our approach is based on multiscale tests to detect significant directional derivatives of the unknown density at arbitrary points in arbitrary directions. The multiscale method is used to identify regions of monotonicity and to construct a general procedure for the detection of modes of the multivariate density. Moreover, as an important application a significance test for the presence of a local maximum at a pre-specified point is proposed. The performance of the new methods is investigated from a theoretical point of view and the finite sample properties are illustrated by means of a small simulation study.
△ Less
Submitted 16 November, 2016;
originally announced November 2016.
-
Regularization parameter selection in indirect regression by residual based bootstrap
Authors:
Nicolai Bissantz,
Justin Chown,
Holger Dette
Abstract:
Residual-based analysis is generally considered a cornerstone of statistical methodology. For a special case of indirect regression, we investigate the residual-based empirical distribution function and provide a uniform expansion of this estimator, which is also shown to be asymptotically most precise. This investigation naturally leads to a completely data-driven technique for selecting a regula…
▽ More
Residual-based analysis is generally considered a cornerstone of statistical methodology. For a special case of indirect regression, we investigate the residual-based empirical distribution function and provide a uniform expansion of this estimator, which is also shown to be asymptotically most precise. This investigation naturally leads to a completely data-driven technique for selecting a regularization parameter used in our indirect regression function estimator. The resulting methodology is based on a smooth bootstrap of the model residuals. A simulation study demonstrates the effectiveness of our approach.
△ Less
Submitted 28 February, 2018; v1 submitted 27 October, 2016;
originally announced October 2016.
-
Smooth backfitting in additive inverse regression
Authors:
Nicolai Bissantz,
Holger Dette,
Thimo Hildebrandt
Abstract:
We consider the problem of estimating an additive regression function in an inverse regres- sion model with a convolution type operator. A smooth backfitting procedure is developed and asymptotic normality of the resulting estimator is established. Compared to other meth- ods for the estimation in additive models the new approach neither requires observations on a regular grid nor the estimation o…
▽ More
We consider the problem of estimating an additive regression function in an inverse regres- sion model with a convolution type operator. A smooth backfitting procedure is developed and asymptotic normality of the resulting estimator is established. Compared to other meth- ods for the estimation in additive models the new approach neither requires observations on a regular grid nor the estimation of the joint density of the predictor. It is also demonstrated by means of a simulation study that the backfitting estimator outperforms the marginal in- tegration method at least by a factor two with respect to the integrated mean squared error criterion.
△ Less
Submitted 4 November, 2013;
originally announced November 2013.
-
Confidence bands for multivariate and time dependent inverse regression models
Authors:
Katharina Proksch,
Nicolai Bissantz,
Holger Dette
Abstract:
Uniform asymptotic confidence bands for a multivariate regression function in an inverse regression model with a convolution-type operator are constructed. The results are derived using strong approximation methods and a limit theorem for the supremum of a stationary Gaussian field over an increasing system of sets. As a particular application, asymptotic confidence bands for a time dependent regr…
▽ More
Uniform asymptotic confidence bands for a multivariate regression function in an inverse regression model with a convolution-type operator are constructed. The results are derived using strong approximation methods and a limit theorem for the supremum of a stationary Gaussian field over an increasing system of sets. As a particular application, asymptotic confidence bands for a time dependent regression function $f_t(x)$ ($x\in \mathbb {R}^d,t\in \mathbb {R}$) in a convolution-type inverse regression model are obtained. Finally, we demonstrate the practical feasibility of our proposed methods in a simulation study and an application to the estimation of the luminosity profile of the elliptical galaxy NGC5017. To the best knowledge of the authors, the results presented in this paper are the first which provide uniform confidence bands for multivariate nonparametric function estimation in inverse problems.
△ Less
Submitted 7 April, 2015; v1 submitted 13 June, 2012;
originally announced June 2012.
-
Improving PSF calibration in confocal microscopic imaging---estimating and exploiting bilateral symmetry
Authors:
Nicolai Bissantz,
Hajo Holzmann,
Mirosław Pawlak
Abstract:
A method for estimating the axis of reflectional symmetry of an image $f(x,y)$ on the unit disc $D=\{(x,y):x^2+y^2\leq1\}$ is proposed, given that noisy data of $f(x,y)$ are observed on a discrete grid of edge width $Δ$. Our estimation procedure is based on minimizing over $β\in[0,π)$ the $L_2$ distance between empirical versions of $f$ and $τ_βf$, the image of $f$ after reflection at the axis alo…
▽ More
A method for estimating the axis of reflectional symmetry of an image $f(x,y)$ on the unit disc $D=\{(x,y):x^2+y^2\leq1\}$ is proposed, given that noisy data of $f(x,y)$ are observed on a discrete grid of edge width $Δ$. Our estimation procedure is based on minimizing over $β\in[0,π)$ the $L_2$ distance between empirical versions of $f$ and $τ_βf$, the image of $f$ after reflection at the axis along $(\cosβ,\sinβ)$. Here, $f$ and $τ_βf$ are estimated using truncated radial series of the Zernike type. The inherent symmetry properties of the Zernike functions result in a particularly simple estimation procedure for $β$. It is shown that the estimate $\hatβ$ converges at the parametric rate $Δ^{-1}$ for images $f$ of bounded variation. Further, we establish asymptotic normality of $\hatβ$ if $f$ is Lipschitz continuous. The method is applied to calibrating the point spread function (PSF) for the deconvolution of images from confocal microscopy. For various reasons the PSF characterizing the problem may not be rotationally invariant but rather only reflection symmetric with respect to two orthogonal axes. For an image of a bead acquired by a confocal laser scanning microscope (Leica TCS), these axes are estimated and corresponding confidence intervals are constructed. They turn out to be close to the coordinate axes of the imaging device. As cause for deviation from rotational invariance, this indicates some slight misalignment of the optical system or anisotropy of the immersion medium rather than some irregular shape of the bead. In an extensive simulation study, we show that using a symmetrized version of the observed PSF significantly improves the subsequent reconstruction process of the target image.
△ Less
Submitted 3 February, 2011;
originally announced February 2011.
