-
On solutions of Kolmogorov's equations for jump Markov processes
Authors:
Eugene A. Feinberg,
Manasa Mandava,
Albert N. Shiryaev
Abstract:
This paper studies three ways to construct a nonhomogeneous jump Markov process: (i) via a compensator of the random measure of a multivariate point process, (ii) as a minimal solution of the backward Kolmogorov equation, and (iii) as a minimal solution of the forward Kolmogorov equation. The main conclusion of this paper is that, for a given measurable transition intensity, commonly called a Q-fu…
▽ More
This paper studies three ways to construct a nonhomogeneous jump Markov process: (i) via a compensator of the random measure of a multivariate point process, (ii) as a minimal solution of the backward Kolmogorov equation, and (iii) as a minimal solution of the forward Kolmogorov equation. The main conclusion of this paper is that, for a given measurable transition intensity, commonly called a Q-function, all these constructions define the same transition function. If this transition function is regular, that is, the probability of accumulation of jumps is zero, then this transition function is the unique solution of the backward and forward Kolmogorov equations. For continuous Q-functions, Kolmogorov equations were studied in Feller's seminal paper. In particular, this paper extends Feller's results for continuous Q-functions to measurable Q-functions and provides additional results.
△ Less
Submitted 5 April, 2013; v1 submitted 29 January, 2013;
originally announced January 2013.
-
Fatou's Lemma for Weakly Converging Probabilities
Authors:
Eugene A. Feinberg,
Pavlo O. Kasyanov,
Nina V. Zadoianchuk
Abstract:
Fatou's lemma states under appropriate conditions that the integral of the lower limit of a sequence of functions is not greater than the lower limit of the integrals. This note describes similar inequalities when, instead of a single measure, the functions are integrated with respect to different measures that form a weakly convergent sequence.
Fatou's lemma states under appropriate conditions that the integral of the lower limit of a sequence of functions is not greater than the lower limit of the integrals. This note describes similar inequalities when, instead of a single measure, the functions are integrated with respect to different measures that form a weakly convergent sequence.
△ Less
Submitted 21 November, 2013; v1 submitted 18 June, 2012;
originally announced June 2012.
-
The Multi-Armed Bandit, with Constraints
Authors:
Eric V. Denardo,
Eugene A. Feinberg,
Uriel G. Rothblum
Abstract:
The early sections of this paper present an analysis of a Markov decision model that is known as the multi-armed bandit under the assumption that the utility function of the decision maker is either linear or exponential. The analysis includes efficient procedures for computing the expected utility associated with the use of a priority policy and for identifying a priority policy that is optimal.…
▽ More
The early sections of this paper present an analysis of a Markov decision model that is known as the multi-armed bandit under the assumption that the utility function of the decision maker is either linear or exponential. The analysis includes efficient procedures for computing the expected utility associated with the use of a priority policy and for identifying a priority policy that is optimal. The methodology in these sections is novel, building on the use of elementary row operations. In the later sections of this paper, the analysis is adapted to accommodate constraints that link the bandits.
△ Less
Submitted 20 March, 2012;
originally announced March 2012.
-
Berge's Theorem for Noncompact Image Sets
Authors:
Eugene A. Feinberg,
Pavlo O. Kasyanov,
Nina V. Zadoianchuk
Abstract:
For an upper semi-continuous set-valued mapping from one topological space to another and for a lower semi-continuous function defined on the product of these spaces, Berge's theorem states lower semi-continuity of the minimum of this function taken over the image sets. It assumes that the image sets are compact. For Hausdorff topological spaces, this paper extends Berge's theorem to set-valued ma…
▽ More
For an upper semi-continuous set-valued mapping from one topological space to another and for a lower semi-continuous function defined on the product of these spaces, Berge's theorem states lower semi-continuity of the minimum of this function taken over the image sets. It assumes that the image sets are compact. For Hausdorff topological spaces, this paper extends Berge's theorem to set-valued mappings with possible noncompact image sets and studies relevant properties of minima.
△ Less
Submitted 6 March, 2012;
originally announced March 2012.
-
Average-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities
Authors:
Eugene A. Feinberg,
Pavlo O. Kasyanov,
Nina V. Zadoianchuk
Abstract:
This paper presents sufficient conditions for the existence of stationary optimal policies for average-cost Markov Decision Processes with Borel state and action sets and with weakly continuous transition probabilities. The one-step cost functions may be unbounded, and action sets may be noncompact. The main contributions of this paper are: (i) general sufficient conditions for the existence of st…
▽ More
This paper presents sufficient conditions for the existence of stationary optimal policies for average-cost Markov Decision Processes with Borel state and action sets and with weakly continuous transition probabilities. The one-step cost functions may be unbounded, and action sets may be noncompact. The main contributions of this paper are: (i) general sufficient conditions for the existence of stationary discount-optimal and average-cost optimal policies and descriptions of properties of value functions and sets of optimal actions, (ii) a sufficient condition for the average-cost optimality of a stationary policy in the form of optimality inequalities, and (iii) approximations of average-cost optimal actions by discount-optimal actions.
△ Less
Submitted 18 February, 2012;
originally announced February 2012.
-
Extension of Lyapunov's Convexity Theorem to Subranges
Authors:
Peng Dai,
Eugene A. Feinberg
Abstract:
Consider a measurable space with a finite vector measure. This measure defines a mapping of the $σ$-field into a Euclidean space. According to Lyapunov's convexity theorem, the range of this mapping is compact and, if the measure is atomless, this range is convex. Similar ranges are also defined for measurable subsets of the space. We show that the union of the ranges of all subsets having the sam…
▽ More
Consider a measurable space with a finite vector measure. This measure defines a mapping of the $σ$-field into a Euclidean space. According to Lyapunov's convexity theorem, the range of this mapping is compact and, if the measure is atomless, this range is convex. Similar ranges are also defined for measurable subsets of the space. We show that the union of the ranges of all subsets having the same given vector measure is also compact and, if the measure is atomless, it is convex. We further provide a geometrically constructed convex compactum in the Euclidean space that contains this union. The equality of these two sets, that holds for two-dimensional measures, can be violated in higher dimensions.
△ Less
Submitted 12 February, 2011;
originally announced February 2011.
-
On Maximal Ranges of Vector Measures for Subsets and Purification of Transition Probabilities
Authors:
Peng Dai,
Eugene A. Feinberg
Abstract:
Consider a measurable space with an atomless finite vector measure. This measure defines a mapping of the $σ$-field into an Euclidean space. According to the Lyapunov convexity theorem, the range of this mapping is a convex compactum. Similar ranges are also defined for measurable subsets of the space. Two subsets with the same vector measure may have different ranges. We investigate the question…
▽ More
Consider a measurable space with an atomless finite vector measure. This measure defines a mapping of the $σ$-field into an Euclidean space. According to the Lyapunov convexity theorem, the range of this mapping is a convex compactum. Similar ranges are also defined for measurable subsets of the space. Two subsets with the same vector measure may have different ranges. We investigate the question whether, among all the subsets having the same given vector measure, there always exists a set with the maximal range of the vector measure. The answer to this question is positive for two-dimensional vector measures and negative for higher dimensions. We use the existence of maximal ranges to strengthen the Dvoretzky-Wald-Wolfowitz purification theorem for the case of two measures.
△ Less
Submitted 11 February, 2011; v1 submitted 2 June, 2010;
originally announced June 2010.
-
Buffer Insertion for Bridges and Optimal Buffer Sizing for Communication Sub-System of Systems-on-Chip
Authors:
Sankalp S. Kallakuri,
Alex Doboli,
Eugene A. Feinberg
Abstract:
We have presented an optimal buffer sizing and buffer insertion methodology which uses stochastic models of the architecture and Continuous Time Markov Decision Processes CTMDPs. Such a methodology is useful in managing the scarce buffer resources available on chip as compared to network based data communication which can have large buffer space. The modeling of this problem in terms of a CT-MDP…
▽ More
We have presented an optimal buffer sizing and buffer insertion methodology which uses stochastic models of the architecture and Continuous Time Markov Decision Processes CTMDPs. Such a methodology is useful in managing the scarce buffer resources available on chip as compared to network based data communication which can have large buffer space. The modeling of this problem in terms of a CT-MDP framework lead to a nonlinear formulation due to usage of bridges in the bus architecture. We present a methodology to split the problem into several smaller though linear systems and we then solve these subsystems.
△ Less
Submitted 25 October, 2007;
originally announced October 2007.
-
Color deconfinement and subhadronic matter: phase states and the role of constituent quarks
Authors:
I. I. Royzen,
E. L. Feinberg,
O. D. Chernavskaya
Abstract:
Major aspects of the subhadronic state of nuclear matter populated with deconfined color particles are reviewed. At high and even at rather low nuclear collision energies, this is expected to be a short-term quark-gluon plasma (QGP), but, seemingly, not only this. Emphasis is put on the self-consistency requirement that must be imposed on any phenomenological description of the evolution of a ho…
▽ More
Major aspects of the subhadronic state of nuclear matter populated with deconfined color particles are reviewed. At high and even at rather low nuclear collision energies, this is expected to be a short-term quark-gluon plasma (QGP), but, seemingly, not only this. Emphasis is put on the self-consistency requirement that must be imposed on any phenomenological description of the evolution of a hot and dense nuclear medium as it expands (cools down) to the point where the final scattering of secondary particles starts. The view is argued and analyzed that massive constituent quarks should then play a major role at a certain cooling stage. A hypothesis is discussed regarding the existence of an intermediate stage (a valon plasma), allowing a consistent explanation of data on the mid-rapidity yields of various kinds of hadrons and direct dileptons (e+e- -pairs) in high-energy heavy-ion collisions.
△ Less
Submitted 28 December, 2004;
originally announced December 2004.
-
Massive constituent quarks and unified description of freeze-out parameters: does QGP form at low temperature?
Authors:
O. D. Chernavskaya,
E. L. Feinberg,
I. I. Royzen
Abstract:
The possibility of unified description of hadron multiple production in heavy ion collisions over the wide energy interval, from few hundreds MeV/n at GSI/SIS through 11 GeV/n at BNL/AGS up to 160 GeV/n at CERN/SPS, has been emphasized recently by J. Cleymans and K. Redlich. They, and somewhat later B. Muller and J. Rafelski, treated this fact as an indication that quark-gluon plasma (QGP) can b…
▽ More
The possibility of unified description of hadron multiple production in heavy ion collisions over the wide energy interval, from few hundreds MeV/n at GSI/SIS through 11 GeV/n at BNL/AGS up to 160 GeV/n at CERN/SPS, has been emphasized recently by J. Cleymans and K. Redlich. They, and somewhat later B. Muller and J. Rafelski, treated this fact as an indication that quark-gluon plasma (QGP) can be produced even at very low energies of impinging nuclei. In our opinion, it rather witnesses that a massive constituent quark (valon) - not massless current quark and gluon! - is just what becomes "quite easily" to be unbound, and thus supports the expectation that in course of compression and heating from hadronic state to QGP (or, vice versa, of expansion and cooling down from QGP to hadronic state) nuclear matter should pass through an intermediate phase in between.
△ Less
Submitted 8 January, 2001;
originally announced January 2001.
-
"Free" Constituent Quarks and Dilepton Production in Heavy Ion Collisions
Authors:
O. D. Chernavskaya,
E. L. Feinberg,
I. I. Royzen
Abstract:
An approach is suggested, invoking vitally the notion of constituent massive quarks (valons) which can survive and propagate rather than hadrons (except of pions) within the hot and dense matter formed below the chiral transition temperature in course of the heavy ion collisions at high energies. This approach is shown to be quite good for description of the experimentally observed excess in dil…
▽ More
An approach is suggested, invoking vitally the notion of constituent massive quarks (valons) which can survive and propagate rather than hadrons (except of pions) within the hot and dense matter formed below the chiral transition temperature in course of the heavy ion collisions at high energies. This approach is shown to be quite good for description of the experimentally observed excess in dilepton yield at masses 250 MeV < M < 700 MeV over the prompt resonance decay mechanism (CERES cocktail) predictions. In certain aspects, it looks to be even more successful, than the conventional approaches: it seems to match the data somewhat better at dilepton masses before the two-pion threshold and before the rho-meson peak as well as at higher dilepton masses (beyond the phi-meson one). The approach implies no specific assumptions on the equation of state (EOS) or peculiarities of phase transitions in the expanding nuclear matter.
△ Less
Submitted 1 November, 2000;
originally announced November 2000.
-
Transformation of the hadronic and subhadronic substances under extreme conditions
Authors:
E. L. Feinberg
Abstract:
Very dense and/or hot hadronic substance (e.g. the one with energy density greatly exceeding that of a normal nucleus) transforms itself into a subhadronic substance which obeys macroscopic classical physics, in particular suffers phase transitions. The most popular Single Phase Transition Model (SPTM) assumes that the new phase is the Quark Gluon Plasma (QGP) consisting of deconfined, chiral sy…
▽ More
Very dense and/or hot hadronic substance (e.g. the one with energy density greatly exceeding that of a normal nucleus) transforms itself into a subhadronic substance which obeys macroscopic classical physics, in particular suffers phase transitions. The most popular Single Phase Transition Model (SPTM) assumes that the new phase is the Quark Gluon Plasma (QGP) consisting of deconfined, chiral symmetric, pointlike "current" quarks q and gluons g of Quantum Chromodynamics (QCD). This paper is devoted to another, Double Phase Transition Model (DPTM) according to which hadronic substance (H) and QGP transform one into another via an intermediate phase consisting of deconfined constituent massive quarks Q which for brevity sake we call also equivalently valons (Q, valonic phase) with broken chiral symmetry (plus pions as Goldstone particles). I. e. we consider the phase transformation chain H-Q-QGP instead of usually assumed H-QGP. The phase transition H-Q is the Hagedorn one and corresponds to the Hagedorn temperature. Connection with the relativistic heavy ion collision is discussed. H-Q transformation may take place even at low (e.g. Dubna) energies.
△ Less
Submitted 16 January, 1997;
originally announced January 1997.
-
Deconfinement of Constituent Quarks and the Hagedorn Temperature
Authors:
O. D. Chernavskaya,
E. L. Feinberg
Abstract:
The double phase transition of hadronic matter, $H$, first, to the gas of deconfined constituent quarks (for brevity called {\it valons}), $Q$, and then, secondly, the phase transition from $Q$ to quark-gluon plasma, $QGP$, is considered within bag model ideology. In distinction from previous double phase transition investigations, it is not supposed that at zero chemical potential (~$μ=0$~) tra…
▽ More
The double phase transition of hadronic matter, $H$, first, to the gas of deconfined constituent quarks (for brevity called {\it valons}), $Q$, and then, secondly, the phase transition from $Q$ to quark-gluon plasma, $QGP$, is considered within bag model ideology. In distinction from previous double phase transition investigations, it is not supposed that at zero chemical potential (~$μ=0$~) transition temperatures $T_d$ (for $H~\leftrightarrow~Q$) and $T_{ch}$ (for $Q~\leftrightarrow~ QGP$, chiral restoration) coincide. Then for plausible range of chosen bag constants, $B_Q$ for $Q$ and $B_q$ for $QGP$ the phase transition $H~ \leftrightarrow~ QGP$ can proceed {\it only via the $Q$ phase} (at least at not too much $μ$). For small $μ$ the gap, $T_{ch}~-~T_d$, is quite essential, up to $\approx~50$ MeV. The physical meaning of the $H~ \leftrightarrow~ Q$ transition temperature, $T_d$, coincide with that of the Hagedorn temperature, $T_H$.
△ Less
Submitted 20 December, 1994;
originally announced December 1994.
