-
Spectral Estimation of Plasma Fluctuations I: Comparison of Methods
Authors:
Kurt S. Riedel,
Alexander Sidorenko,
David J. Thomson
Abstract:
The relative root mean squared errors (RMSE) of nonparametric methods for spectral estimation is compared for microwave scattering data of plasma fluctuations. These methods reduce the variance of the periodogram estimate by averaging the spectrum over a frequency bandwidth. As the bandwidth increases, the variance decreases, but the bias error increases. The plasma spectra vary by over four order…
▽ More
The relative root mean squared errors (RMSE) of nonparametric methods for spectral estimation is compared for microwave scattering data of plasma fluctuations. These methods reduce the variance of the periodogram estimate by averaging the spectrum over a frequency bandwidth. As the bandwidth increases, the variance decreases, but the bias error increases. The plasma spectra vary by over four orders of magnitude, and therefore, using a spectral window is necessary. We compare the smoothed tapered periodogram with the adaptive multiple taper methods and hybrid methods. We find that a hybrid method, which uses four orthogonal tapers and then applies a kernel smoother, performs best. For 300 point data segments, even an optimized smoothed tapered periodogram has a 24 \% larger relative RMSE than the hybrid method. We present two new adaptive multi-taper weightings which outperform Thomson's original adaptive weighting.
△ Less
Submitted 30 March, 2018;
originally announced April 2018.
-
Spectral Estimation of Plasma Fluctuations II: Nonstationary Analysis of ELM Spectra
Authors:
Kurt S. Riedel,
Alexander Sidorenko,
Norton Bretz,
David J. Thomson
Abstract:
Several analysis methods for nonstationary fluctuations are described and applied to the edge localized mode (ELM) instabilities of limiter H-mode plasmas. The microwave scattering diagnostic observes poloidal $k_θ$ values of 3.3 cm$^{-1}$, averaged over a 20 cm region at the plasma edge.A short autoregressive filter enhances the nonstationary component of the plasma fluctuations by removing much…
▽ More
Several analysis methods for nonstationary fluctuations are described and applied to the edge localized mode (ELM) instabilities of limiter H-mode plasmas. The microwave scattering diagnostic observes poloidal $k_θ$ values of 3.3 cm$^{-1}$, averaged over a 20 cm region at the plasma edge.A short autoregressive filter enhances the nonstationary component of the plasma fluctuations by removing much of the background level of stationary fluctuations. Between ELMs, the spectrum predominantly consists of broad-banded 300-700 kHz fluctuations propagating in the electron diamagnetic drift direction, indicating the presence of a negative electric field near the plasma edge. The time-frequency spectrogram is computed with the multiple taper technique. By using the singular value decomposition of the spectrogram, it is shown that the spectrum during the ELM is broader and more symmetric than that of the stationary spectrum. The ELM period and the evolution of the spectrum between ELMs varies from discharge to discharge. For the discharge under consideration which has distinct ELMs with a 1 msec period, the spectrum has a maximum in the electron drift direction which relaxes to a near constant value %its characteristic shape in the first half millisecond after the end of the ELM and then grows slowly. In contrast, the level of the fluctuations in the ion drift direction increases exponentially by a factor of eight in the five milliseconds~after the ELM. High frequency precursors are found which occur one millisecond before the ELMs and propagate in the ion drift direction. These precursors are very short ($\sim 10 μ$secs), coherent bursts, and they predict the occurrence of an ELM with a high success rate.
△ Less
Submitted 29 March, 2018; v1 submitted 16 March, 2018;
originally announced March 2018.
-
Sufficient Conditions for a Linear Estimator to be a Local Polynomial Regression
Authors:
Alexander Sidorenko,
Kurt S. Riedel
Abstract:
It is shown that any linear estimator that satisfies the moment conditions up to order $p$ is equivalent to a local polynomial regression of order $p$ with some non-negative weight function if and only if the kernel has at most $p$ sign changes. If the data points are placed symmetrically about the estimation point, a linear weighting function is equivalent to the standard quadratic weighting func…
▽ More
It is shown that any linear estimator that satisfies the moment conditions up to order $p$ is equivalent to a local polynomial regression of order $p$ with some non-negative weight function if and only if the kernel has at most $p$ sign changes. If the data points are placed symmetrically about the estimation point, a linear weighting function is equivalent to the standard quadratic weighting function.
△ Less
Submitted 15 March, 2018;
originally announced March 2018.
-
Optimal Boundary Kernels and Weightings for Local Polynomial Regression
Authors:
Alexander Sidorenko,
Kurt S. Riedel
Abstract:
Kernel smoothers are considered near the boundary of the interval. Kernels which minimize the expected mean square error are derived. These kernels are equivalent to using a linear weighting function in the local polynomial regression. It is shown that any kernel estimator that satisfies the moment conditions up to order $m$ is equivalent to a local polynomial regression of order $m$ with some non…
▽ More
Kernel smoothers are considered near the boundary of the interval. Kernels which minimize the expected mean square error are derived. These kernels are equivalent to using a linear weighting function in the local polynomial regression. It is shown that any kernel estimator that satisfies the moment conditions up to order $m$ is equivalent to a local polynomial regression of order $m$ with some non-negative weight function if and only if the kernel has at most $m$ sign changes. A fast algorithm is proposed for computing the kernel estimate in the boundary region for an arbitrary placement of data points.
△ Less
Submitted 25 March, 2018; v1 submitted 15 March, 2018;
originally announced March 2018.
-
Minimum bias multiple taper spectral estimation
Authors:
Kurt S. Riedel,
Alexander Sidorenko
Abstract:
Two families of orthonormal tapers are proposed for multi-taper spectral analysis: minimum bias tapers, and sinusoidal tapers $\{ \bf{v}^{(k)}\}$, where $v_n^{(k)}=\sqrt{\frac{2}{N+1}}\sin\frac{πkn}{N+1}$, and $N$ is the number of points. The resulting sinusoidal multitaper spectral estimate is $\hat{S}(f)=\frac{1}{2K(N+1)} \sum_{j=1}^K |y(f+\frac{j}{2N+2}) -y(f-\frac{j}{2N+2})|^2$, where $y(f)$ i…
▽ More
Two families of orthonormal tapers are proposed for multi-taper spectral analysis: minimum bias tapers, and sinusoidal tapers $\{ \bf{v}^{(k)}\}$, where $v_n^{(k)}=\sqrt{\frac{2}{N+1}}\sin\frac{πkn}{N+1}$, and $N$ is the number of points. The resulting sinusoidal multitaper spectral estimate is $\hat{S}(f)=\frac{1}{2K(N+1)} \sum_{j=1}^K |y(f+\frac{j}{2N+2}) -y(f-\frac{j}{2N+2})|^2$, where $y(f)$ is the Fourier transform of the stationary time series, $S(f)$ is the spectral density, and $K$ is the number of tapers. For fixed $j$, the sinusoidal tapers converge to the minimum bias tapers like $1/N$. Since the sinusoidal tapers have analytic expressions, no numerical eigenvalue decomposition is necessary. Both the minimum bias and sinusoidal tapers have no additional parameter for the spectral bandwidth. The bandwidth of the $j$th taper is simply $\frac{1}{N}$ centered about the frequencies $\frac{\pm j}{2N+2}$. Thus the bandwidth of the multitaper spectral estimate can be adjusted locally by simply adding or deleting tapers. The band limited spectral concentration, $\int_{-w}^w |V(f)|^2 df$, of both the minimum bias and sinusoidal tapers is very close to the optimal concentration achieved by the Slepian tapers. In contrast, the Slepian tapers can have the local bias, $\int_{-1/2}^{1/2} f^2 |V(f)|^2 df$, much larger than of the minimum bias tapers and the sinusoidal tapers.
△ Less
Submitted 29 March, 2018; v1 submitted 11 March, 2018;
originally announced March 2018.
-
Function Estimation Using Data Adaptive Kernel Estimation - How Much Smoothing?
Authors:
Kurt S. Riedel,
A. Sidorenko
Abstract:
We determine the expected error by smoothing the data locally. Then we optimize the shape of the kernel smoother to minimize the error. Because the optimal estimator depends on the unknown function, our scheme automatically adjusts to the unknown function. By self-consistently adjusting the kernel smoother, the total estimator adapts to the data.
Goodness of fit estimators select a kernel halfwi…
▽ More
We determine the expected error by smoothing the data locally. Then we optimize the shape of the kernel smoother to minimize the error. Because the optimal estimator depends on the unknown function, our scheme automatically adjusts to the unknown function. By self-consistently adjusting the kernel smoother, the total estimator adapts to the data.
Goodness of fit estimators select a kernel halfwidth by minimizing a function of the halfwidth which is based on the average square residual fit error: $ASR(h)$. A penalty term is included to adjust for using the same data to estimate the function and to evaluate the mean square error. Goodness of fit estimators are relatively simple to implement, but the minimum (of the goodness of fit functional) tends to be sensitive to small perturbations. To remedy this sensitivity problem, we fit the mean square error %goodness of fit functional to a two parameter model prior to determining the optimal halfwidth.
Plug-in derivative estimators estimate the second derivative of the unknown function in an initial step, and then substitute this estimate into the asymptotic formula.
△ Less
Submitted 11 March, 2018;
originally announced March 2018.
-
Adaptive Smoothing of the Log-Spectrum with Multiple Tapering
Authors:
Kurt S. Riedel,
A. Sidorenko
Abstract:
A hybrid estimator of the log-spectral density of a stationary time series is proposed. First, a multiple taper estimate is performed, followed by kernel smoothing the log-multiple taper estimate. This procedure reduces the expected mean square error by $(π^2/ 4)^{4/5} $ over simply smoothing the log tapered periodogram. A data adaptive implementation of a variable bandwidth kernel smoother is giv…
▽ More
A hybrid estimator of the log-spectral density of a stationary time series is proposed. First, a multiple taper estimate is performed, followed by kernel smoothing the log-multiple taper estimate. This procedure reduces the expected mean square error by $(π^2/ 4)^{4/5} $ over simply smoothing the log tapered periodogram. A data adaptive implementation of a variable bandwidth kernel smoother is given.
△ Less
Submitted 11 March, 2018;
originally announced March 2018.
-
Adaptive Kernel Estimation of the Spectral Density with Boundary Kernel Analysis
Authors:
Alexander Sidorenko,
Kurt S. Riedel
Abstract:
A hybrid estimator of the log-spectral density of a stationary time series is proposed. First, a multiple taper estimate is performed, followed by kernel smoothing the log-multitaper estimate. This procedure reduces the expected mean square error by $({π^2 \over 4})^{.8}$ over simply smoothing the log tapered periodogram. The optimal number of tapers is $O(N^{8/15})$. A data adaptive implementatio…
▽ More
A hybrid estimator of the log-spectral density of a stationary time series is proposed. First, a multiple taper estimate is performed, followed by kernel smoothing the log-multitaper estimate. This procedure reduces the expected mean square error by $({π^2 \over 4})^{.8}$ over simply smoothing the log tapered periodogram. The optimal number of tapers is $O(N^{8/15})$. A data adaptive implementation of a variable bandwidth kernel smoother is given. When the spectral density is discontinuous, one sided smoothing estimates are used.
△ Less
Submitted 11 March, 2018;
originally announced March 2018.
