Showing 1–2 of 2 results for author: Tsumura, K
-
Relaxation of the EM Algorithm via Quantum Annealing
Authors:
Hideyuki Miyahara,
Koji Tsumura
Abstract:
The EM algorithm is a novel numerical method to obtain maximum likelihood estimates and is often used for practical calculations. However, many of maximum likelihood estimation problems are nonconvex, and it is known that the EM algorithm fails to give the optimal estimate by being trapped by local optima. In order to deal with this difficulty, we propose a deterministic quantum annealing EM algor…
▽ More
The EM algorithm is a novel numerical method to obtain maximum likelihood estimates and is often used for practical calculations. However, many of maximum likelihood estimation problems are nonconvex, and it is known that the EM algorithm fails to give the optimal estimate by being trapped by local optima. In order to deal with this difficulty, we propose a deterministic quantum annealing EM algorithm by introducing the mathematical mechanism of quantum fluctuations into the conventional EM algorithm because quantum fluctuations induce the tunnel effect and are expected to relax the difficulty of nonconvex optimization problems in the maximum likelihood estimation problems. We show a theorem that guarantees its convergence and give numerical experiments to verify its efficiency.
△ Less
Submitted 5 June, 2016;
originally announced June 2016.
-
Optimal Quantization of Signals for System Identification
Authors:
Koji Tsumura
Abstract:
In this paper, we examine the optimal quantization of signals for system identification. We deal with memoryless quantization for the output signals and derive the optimal quantization schemes. The objective functions are the errors of least squares parameter estimation subject to a constraint on the number of subsections of the quantized signals or the expectation of the optimal code length for…
▽ More
In this paper, we examine the optimal quantization of signals for system identification. We deal with memoryless quantization for the output signals and derive the optimal quantization schemes. The objective functions are the errors of least squares parameter estimation subject to a constraint on the number of subsections of the quantized signals or the expectation of the optimal code length for either high or low resolution. In the high-resolution case, the optimal quantizer is found by solving Euler-Lagrange's equations and the solutions are simple functions of the probability densities of the regressor vector. In order to clarify the minute structure of the quantization, the optimal quantizer in the low resolution case is found by solving recursively a minimization of a one-dimensional rational function. The solution has the property that it is coarse near the origin of its input and becomes dense away from the origin in the usual situation. Finally the required quantity of data to decrease the total parameter estimation error, caused by quantization and noise, is discussed.
△ Less
Submitted 12 May, 2009;
originally announced May 2009.
