-
Optimization Insights into Deep Diagonal Linear Networks
Authors:
Hippolyte Labarrière,
Cesare Molinari,
Lorenzo Rosasco,
Silvia Villa,
Cristian Vega
Abstract:
Overparameterized models trained with (stochastic) gradient descent are ubiquitous in modern machine learning. These large models achieve unprecedented performance on test data, but their theoretical understanding is still limited. In this paper, we take a step towards filling this gap by adopting an optimization perspective. More precisely, we study the implicit regularization properties of the g…
▽ More
Overparameterized models trained with (stochastic) gradient descent are ubiquitous in modern machine learning. These large models achieve unprecedented performance on test data, but their theoretical understanding is still limited. In this paper, we take a step towards filling this gap by adopting an optimization perspective. More precisely, we study the implicit regularization properties of the gradient flow "algorithm" for estimating the parameters of a deep diagonal neural network. Our main contribution is showing that this gradient flow induces a mirror flow dynamic on the model, meaning that it is biased towards a specific solution of the problem depending on the initialization of the network. Along the way, we prove several properties of the trajectory.
△ Less
Submitted 1 April, 2025; v1 submitted 21 December, 2024;
originally announced December 2024.
-
Delayed Feedback in Online Non-Convex Optimization: A Non-Stationary Approach with Applications
Authors:
Felipe Lara,
Cristian Vega
Abstract:
We study non-convex delayed-noise online optimization problems by evaluating dynamic regret in the non-stationary setting when the loss functions are quasar-convex. In particular, we consider scenarios involving quasar-convex functions either with a Lipschitz gradient or weakly smooth and, for each case, we ensure bounded dynamic regret in terms of cumulative path variation achieving sub-linear re…
▽ More
We study non-convex delayed-noise online optimization problems by evaluating dynamic regret in the non-stationary setting when the loss functions are quasar-convex. In particular, we consider scenarios involving quasar-convex functions either with a Lipschitz gradient or weakly smooth and, for each case, we ensure bounded dynamic regret in terms of cumulative path variation achieving sub-linear regret rates. Furthermore, we illustrate the flexibility of our framework by applying it to both theoretical settings such as zeroth-order (bandit) and also to practical applications with quadratic fractional functions. Moreover, we provide new examples of non-convex functions that are quasar-convex by proving that the class of differentiable strongly quasiconvex functions (Polyak 1966) are strongly quasar-convex on convex compact sets. Finally, several numerical experiments validate our theoretical findings, illustrating the effectiveness of our approach.
△ Less
Submitted 8 May, 2025; v1 submitted 18 December, 2024;
originally announced December 2024.
-
Relaxed and Inertial Nonlinear Forward-Backward with Momentum
Authors:
Fernando Roldán,
Cristian Vega
Abstract:
In this article, we study inertial algorithms for numerically solving monotone inclusions involving the sum of a maximally monotone and a cocoercive operator. In particular, we analyze the convergence of inertial and relaxed versions of the nonlinear forward-backward with momentum (NFBM). We propose an inertial version including a relaxation step, and a second version considering a double-inertial…
▽ More
In this article, we study inertial algorithms for numerically solving monotone inclusions involving the sum of a maximally monotone and a cocoercive operator. In particular, we analyze the convergence of inertial and relaxed versions of the nonlinear forward-backward with momentum (NFBM). We propose an inertial version including a relaxation step, and a second version considering a double-inertial step with additional momentum. By applying NFBM to specific monotone inclusions, we derive inertial and relaxed versions of algorithms such as forward-backward, forward-half-reflect-backward (FHRB), Chambolle-Pock, Condat-Vũ, among others, thereby recovering and extending previous results from the literature for solving monotone inclusions involving maximally monotone, cocoercive, monotone and Lipschitz, and linear bounded operators. We also present numerical experiments on image restoration, comparing the proposed inertial and relaxation algorithms. In particular, we compare the inertial FHRB with its non-inertial and momentum versions. Additionally, we compare the numerical convergence for larger step-sizes versus relaxation parameters and introduce a restart strategy that incorporates larger step-sizes and inertial steps to further enhance numerical convergence.
△ Less
Submitted 2 December, 2024;
originally announced December 2024.
-
Optimal Ratcheting of Dividends with Irreversible Reinsurance
Authors:
Tim J. Boonen,
Engel John C. Dela Vega
Abstract:
This paper considers an insurance company that faces two key constraints: a ratcheting dividend constraint and an irreversible reinsurance constraint. The company allocates part of its reserve to pay dividends to its shareholders while strategically purchasing reinsurance for its claims. The ratcheting dividend constraint ensures that dividend cuts are prohibited at any time. The irreversible rein…
▽ More
This paper considers an insurance company that faces two key constraints: a ratcheting dividend constraint and an irreversible reinsurance constraint. The company allocates part of its reserve to pay dividends to its shareholders while strategically purchasing reinsurance for its claims. The ratcheting dividend constraint ensures that dividend cuts are prohibited at any time. The irreversible reinsurance constraint ensures that reinsurance contracts cannot be prematurely terminated or sold to external entities. The dividend rate level and the reinsurance level are modelled as nondecreasing processes, thereby satisfying the constraints. The incurred claims are modelled via a Brownian risk model. The main objective is to maximize the cumulative expected discounted dividend payouts until the time of ruin. The reinsurance and dividend levels belong to either a finite set or a closed interval. The optimal value functions for the finite set case and the closed interval case are proved to be the unique viscosity solutions of the corresponding Hamilton-Jacobi-Bellman equations, and the convergence between these optimal value functions is established. For the finite set case, a threshold strategy is proved to be optimal, while for the closed interval case, an $ε$-optimal strategy is constructed. Finally, numerical examples are presented to illustrate the optimality conditions and optimal strategies.
△ Less
Submitted 29 August, 2024;
originally announced August 2024.
-
Optimal control for a SIR model with limited hospitalised patients
Authors:
Rocío Balderrama,
Mariana Inés Prieto,
Constanza Sánchez de la Vega,
Federico Vazquez
Abstract:
This paper analyses the optimal control of infectious disease propagation using a classic susceptible-infected-recovered (SIR) model characterised by permanent immunity and the absence of available vaccines. The control is performed over a time-dependent mean reproduction number, in order to minimise the cumulative number of ever-infected individuals (recovered), under different constraints. We co…
▽ More
This paper analyses the optimal control of infectious disease propagation using a classic susceptible-infected-recovered (SIR) model characterised by permanent immunity and the absence of available vaccines. The control is performed over a time-dependent mean reproduction number, in order to minimise the cumulative number of ever-infected individuals (recovered), under different constraints. We consider constraints on isolation measures ranging from partial lockdown to non-intervention, as well as the social and economic costs associated with such isolation, and the capacity limitations of intensive care units that limits the number of infected individuals to a maximum allowed value. We rigorously derive an optimal quarantine strategy based on necessary optimality conditions. The obtained optimal strategy is of a boundary-bang type, comprising three phases: an initial phase with no intervention, a second phase maintaining the infected population at its maximum possible value, and a final phase of partial lockdown applied over a single interval. The optimal policy is further refined by optimising the transition times between these phases. We show that these results are in excellent agreement with the numerical solution of the problem.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Fast iterative regularization by reusing data
Authors:
Cristian Vega,
Cesare Molinari,
Lorenzo Rosasco,
Silvia Villa
Abstract:
Discrete inverse problems correspond to solving a system of equations in a stable way with respect to noise in the data. A typical approach to enforce uniqueness and select a meaningful solution is to introduce a regularizer. While for most applications the regularizer is convex, in many cases it is not smooth nor strongly convex. In this paper, we propose and study two new iterative regularizatio…
▽ More
Discrete inverse problems correspond to solving a system of equations in a stable way with respect to noise in the data. A typical approach to enforce uniqueness and select a meaningful solution is to introduce a regularizer. While for most applications the regularizer is convex, in many cases it is not smooth nor strongly convex. In this paper, we propose and study two new iterative regularization methods, based on a primal-dual algorithm, to solve inverse problems efficiently. Our analysis, in the noise free case, provides convergence rates for the Lagrangian and the feasibility gap. In the noisy case, it provides stability bounds and early-stopping rules with theoretical guarantees. The main novelty of our work is the exploitation of some a priori knowledge about the solution set, i.e. redundant information. More precisely we show that the linear systems can be used more than once along the iteration. Despite the simplicity of the idea, we show that this procedure brings surprising advantages in the numerical applications. We discuss various approaches to take advantage of redundant information, that are at the same time consistent with our assumptions and flexible in the implementation. Finally, we illustrate our theoretical findings with numerical simulations for robust sparse recovery and image reconstruction through total variation. We confirm the efficiency of the proposed procedures, comparing the results with state-of-the-art methods.
△ Less
Submitted 21 April, 2022;
originally announced April 2022.
-
Backward stochastic differential equations with regime-switching and sublinear expectations
Authors:
Engel John C. Dela Vega,
Robert J. Elliott
Abstract:
This paper introduces a backward stochastic differential equation driven by both Brownian motion and a Markov chain (BSDEBM). Regime-switching is also incorporated through its driver. The existence and uniqueness of the solution of the BSDEBM are proved. A comparison theorem is also derived. Filtration consistent sublinear expectations are defined and characterized as solutions to the BSDEBM. The…
▽ More
This paper introduces a backward stochastic differential equation driven by both Brownian motion and a Markov chain (BSDEBM). Regime-switching is also incorporated through its driver. The existence and uniqueness of the solution of the BSDEBM are proved. A comparison theorem is also derived. Filtration consistent sublinear expectations are defined and characterized as solutions to the BSDEBM. The bid and ask prices are then represented using sublinear expectations.
△ Less
Submitted 4 December, 2021;
originally announced December 2021.
-
Optimal control for a SIR epidemic model with limited quarantine
Authors:
Rocío Balderrama,
Javier Peressutti,
Juan Pablo Pinasco,
Constanza Sánchez de la Vega,
Federico Vázquez
Abstract:
We study first order necessary conditions for an optimal control problem of a Susceptible-Infected-Recovered (SIR) model with limitations on the duration of the quarantine. The control is done by means of the reproduction number, i.e., the number of secondary infections produced by a primary infection, which represents an external intervention that we assume time-dependent. Moreover, the control f…
▽ More
We study first order necessary conditions for an optimal control problem of a Susceptible-Infected-Recovered (SIR) model with limitations on the duration of the quarantine. The control is done by means of the reproduction number, i.e., the number of secondary infections produced by a primary infection, which represents an external intervention that we assume time-dependent. Moreover, the control function can only be applied over a finite time interval, and the duration of the most strict quarantine (smallest possible reproduction number) is also bounded. We consider a maximization problem where the cost functional has two terms: one is the number of susceptible individuals in the long-term and the other depends on the cost of interventions. When the intervention term is linear with respect to the control, we obtain that the optimal solution is bang-bang, and we characterize the times to begin and end the strict quarantine. In the general case, when the cost functional includes the term that measures the intervention cost, we analyze the optimality of controls through numerical computations.
△ Less
Submitted 24 July, 2021;
originally announced July 2021.
-
Spacetime distances: an exploration
Authors:
Carlos Vega
Abstract:
What is the distance between two points in spacetime? This is a basic geometric question, which so far has no single, definitive answer. Unlike their Riemannian cousins, Lorentzian manifolds are not known to carry a canonical distance function. There is, however, a well-known way to `Riemannianize' a Lorentzian metric tensor, under suitable conditions, (e.g., `Wick rotation'). In a fairly differen…
▽ More
What is the distance between two points in spacetime? This is a basic geometric question, which so far has no single, definitive answer. Unlike their Riemannian cousins, Lorentzian manifolds are not known to carry a canonical distance function. There is, however, a well-known way to `Riemannianize' a Lorentzian metric tensor, under suitable conditions, (e.g., `Wick rotation'). In a fairly different vein, a new `null distance function' was also introduced in [18]. Our goal here is to begin an exploration of the broad question of distance functions on spacetimes in general, including a concrete comparison of the aforementioned constructions. We devote special attention to the model `generalized Robertson-Walker' (GRW) setting, and also study how the `classical FLRW big bangs' manifest in terms of such distance functions, and associated metric completions.
△ Less
Submitted 8 March, 2021; v1 submitted 1 March, 2021;
originally announced March 2021.
-
Random Activations in Primal-Dual Splittings for Monotone Inclusions with a priori Information
Authors:
Luis Briceño-Arias,
Julio Deride,
Cristian Vega
Abstract:
In this paper, we propose a numerical approach for solving composite primal-dual monotone inclusions with a priori information. The underlying a priori information set is represented by the intersection of fixed point sets of a finite number of operators, and we propose and algorithm that activates the corresponding set by following a finite-valued random variable at each iteration. Our formulatio…
▽ More
In this paper, we propose a numerical approach for solving composite primal-dual monotone inclusions with a priori information. The underlying a priori information set is represented by the intersection of fixed point sets of a finite number of operators, and we propose and algorithm that activates the corresponding set by following a finite-valued random variable at each iteration. Our formulation is flexible and includes, for instance, deterministic and Bernoulli activations over cyclic schemes, and Kaczmarz-type random activations. The almost sure convergence of the algorithm is obtained by means of properties of stochastic Quasi-Fejér sequences. We also recover several primal-dual algorithms for monotone inclusions in the context without a priori information and classical algorithms for solving convex feasibility problems and linear systems. In the context of convex optimization with inequality constraints, any selection of the constraints defines the a priori information set, in which case the operators involved are simply projections onto half spaces. By incorporating random projections onto a selection of the constraints to classical primal-dual schemes, we obtain faster algorithms as we illustrate by means of a numerical application to a stochastic arc capacity expansion problem in a transport network.
△ Less
Submitted 4 November, 2020;
originally announced November 2020.
-
Rigidity in vacuum under conformal symmetry
Authors:
Gregory J. Galloway,
Carlos Vega
Abstract:
Moitvated in part by [3], in this note we obtain a rigidity result for globally hyperbolic vacuum spacetimes in arbitrary dimension that admit a timelike conformal Killing vector field. Specifically, we show that if M is a Ricci flat, timelike geodesically complete spacetime with compact Cauchy surfaces that admits a timelike conformal Killing field X, then M must split as a metric product, and X…
▽ More
Moitvated in part by [3], in this note we obtain a rigidity result for globally hyperbolic vacuum spacetimes in arbitrary dimension that admit a timelike conformal Killing vector field. Specifically, we show that if M is a Ricci flat, timelike geodesically complete spacetime with compact Cauchy surfaces that admits a timelike conformal Killing field X, then M must split as a metric product, and X must be Killing. This gives a partial proof of the Bartnik splitting conjecture in the vacuum setting.
△ Less
Submitted 3 December, 2017;
originally announced December 2017.
-
Hausdorff closed limits and rigidity in Lorentzian geometry
Authors:
Gregory J. Galloway,
Carlos Vega
Abstract:
We begin with a basic exploration of the (point-set topological) notion of Hausdorff closed limits in the spacetime setting. Specifically, we show that this notion of limit is well suited to sequences of achronal sets, and use this to generalize the `achronal limits' introduced in [12]. This, in turn, allows for a broad generalization of the notion of Lorentzian horosphere introduced in [12]. We p…
▽ More
We begin with a basic exploration of the (point-set topological) notion of Hausdorff closed limits in the spacetime setting. Specifically, we show that this notion of limit is well suited to sequences of achronal sets, and use this to generalize the `achronal limits' introduced in [12]. This, in turn, allows for a broad generalization of the notion of Lorentzian horosphere introduced in [12]. We prove a new rigidity result for such horospheres, which in a sense encodes various spacetime splitting results, including the basic Lorentzian splitting theorem. We use this to give a partial proof of the Bartnik splitting conjecture, under a new condition involving past and future Cauchy horospheres, which is weaker than those considered in [10] and [12]. We close with some observations on spacetimes with spacelike causal boundary, including a rigidity result in the positive cosmological constant case.
△ Less
Submitted 22 August, 2016;
originally announced August 2016.
-
Null distance on a spacetime
Authors:
Christina Sormani,
Carlos Vega
Abstract:
Given a time function $τ$ on a spacetime $M$, we define a `null distance function', $\hat{d}_τ$, built from and closely related to the causal structure of $M$. In basic models with timelike $\nabla τ$, we show that 1) $\hat{d}_τ$ is a definite distance function, which induces the manifold topology, 2) the causal structure of $M$ is completely encoded in $\hat{d}_τ$ and $τ$. In general,…
▽ More
Given a time function $τ$ on a spacetime $M$, we define a `null distance function', $\hat{d}_τ$, built from and closely related to the causal structure of $M$. In basic models with timelike $\nabla τ$, we show that 1) $\hat{d}_τ$ is a definite distance function, which induces the manifold topology, 2) the causal structure of $M$ is completely encoded in $\hat{d}_τ$ and $τ$. In general, $\hat{d}_τ$ is a conformally invariant pseudometric, which may be indefinite. We give an `anti-Lipschitz' condition on $τ$, which ensures that $\hat{d}_τ$ is definite, and show this condition to be satisfied whenever $τ$ has gradient vectors $\nabla τ$ almost everywhere, with $\nabla τ$ locally `bounded away from the light cones'. As a consequence, we show that the cosmological time function of [1] is anti-Lipschitz when `regular', and hence induces a definite null distance function. This provides what may be interpreted as a canonical metric space structure on spacetimes which emanate from a common initial singularity, e.g. a `big bang'.
△ Less
Submitted 15 January, 2016; v1 submitted 3 August, 2015;
originally announced August 2015.
-
High order methods for irreversible equations
Authors:
Mariano De Leo,
Diego Rial,
Constanza Sanchez de la Vega
Abstract:
In this work, we show high order splitting methods of integration without negative steps, allowing us to solve numerically irreversible problems, like reaction-diffusion equations. The methods consist in a suitable affine combinations of Lie-Trotter schemes with different steps. We prove convergence of this methods for a large class of semi-linear problems, that includes Hamiltonian and reaction-d…
▽ More
In this work, we show high order splitting methods of integration without negative steps, allowing us to solve numerically irreversible problems, like reaction-diffusion equations. The methods consist in a suitable affine combinations of Lie-Trotter schemes with different steps. We prove convergence of this methods for a large class of semi-linear problems, that includes Hamiltonian and reaction-diffusion systems.
△ Less
Submitted 18 October, 2014; v1 submitted 14 October, 2013;
originally announced October 2013.
-
Lie-Trotter method for abstract semilinear evolution equations
Authors:
Juan Pablo Borgna,
Mariano De Leo,
Diego Rial,
Constanza Sánchez de la Vega
Abstract:
In this paper we present a unified picture concerning Lie-Trotter method for solving a large class of semilinear problems: nonlinear Schrödinger, Schröginger--Poisson, Gross--Pitaevskii, etc. This picture includes more general schemes such as Strang and Ruth--Yoshida. The convergence result is presented in suitable Hilbert spaces related with the time regularity of the solution and is based on Lip…
▽ More
In this paper we present a unified picture concerning Lie-Trotter method for solving a large class of semilinear problems: nonlinear Schrödinger, Schröginger--Poisson, Gross--Pitaevskii, etc. This picture includes more general schemes such as Strang and Ruth--Yoshida. The convergence result is presented in suitable Hilbert spaces related with the time regularity of the solution and is based on Lipschitz estimates for the nonlinearity. In addition, with extra requirements both on the regularity of the initial datum and on the nonlinearity we show the linear convergence of the method.
△ Less
Submitted 21 November, 2012;
originally announced November 2012.
-
Achronal limits, Lorentzian spheres, and splitting
Authors:
Gregory J. Galloway,
Carlos Vega
Abstract:
In the early 80's S.-T. Yau posed the problem of establishing the rigidity of the Hawking-Penrose singularity theorems. Approaches to this problem have involved the introduction of Lorentzian Busemann functions and the study of the geometry of their level sets - the horospheres. The regularity theory in the Lorentzian case is considerably more complicated and less complete than in the Riemannian c…
▽ More
In the early 80's S.-T. Yau posed the problem of establishing the rigidity of the Hawking-Penrose singularity theorems. Approaches to this problem have involved the introduction of Lorentzian Busemann functions and the study of the geometry of their level sets - the horospheres. The regularity theory in the Lorentzian case is considerably more complicated and less complete than in the Riemannian case. In this paper we introduce a broad generalization of the notion of horosphere in Lorentzian geometry and take a completely different (and highly geometric) approach to regularity. These generalized horospheres are defined in terms of 'achronal limits', and the improved regularity we obtain is based on regularity properties of achronal boundaries. We establish a splitting result for generalized horospheres, which when specialized to 'Cauchy horospheres' yields new results on the Bartnik splitting conjecture, a concrete realization of the problem posed by Yau. Our methods are also applied to spacetimes with positive cosmological constant. We obtain a rigid singularity result for future asymptotically de Sitter spacetimes related to results in [1,7].
△ Less
Submitted 20 October, 2013; v1 submitted 11 November, 2012;
originally announced November 2012.
-
First and second order optimality conditions for optimal control problems of state constrained integral equations
Authors:
J. Frédéric Bonnans,
Constanza De La Vega,
Xavier Dupuis
Abstract:
This paper deals with optimal control problems of integral equations, with initial-final and running state constraints. The order of a running state constraint is defined in the setting of integral dynamics, and we work here with constraints of arbitrary high orders. First and second-order necessary conditions of optimality are obtained, as well as second-order sufficient conditions.
This paper deals with optimal control problems of integral equations, with initial-final and running state constraints. The order of a running state constraint is defined in the setting of integral dynamics, and we work here with constraints of arbitrary high orders. First and second-order necessary conditions of optimality are obtained, as well as second-order sufficient conditions.
△ Less
Submitted 6 June, 2012; v1 submitted 16 May, 2012;
originally announced May 2012.
-
Controllability of Schroedinger equation with a nonlocal term
Authors:
Mariano De Leo,
Constanza Sánchez Fernández de la Vega,
Diego Rial
Abstract:
This paper is concerned with the internal distributed control problem for the 1D Schroedinger equation, $i\,u_t(x,t)=-u_{xx}+α(x)\,u+m(u)\,u,$ that arises in quantum semiconductor models. Here $m(u)$ is a non local Hartree--type nonlinearity stemming from the coupling with the 1D Poisson equation, and $α(x)$ is a regular function with linear growth at infinity, including constant electric fields.…
▽ More
This paper is concerned with the internal distributed control problem for the 1D Schroedinger equation, $i\,u_t(x,t)=-u_{xx}+α(x)\,u+m(u)\,u,$ that arises in quantum semiconductor models. Here $m(u)$ is a non local Hartree--type nonlinearity stemming from the coupling with the 1D Poisson equation, and $α(x)$ is a regular function with linear growth at infinity, including constant electric fields. By means of both the Hilbert Uniqueness Method and the Schauder's fixed point theorem it is shown that for initial and target states belonging to a suitable small neighborhood of the origin, and for distributed controls supported outside of a fixed compact interval, the model equation is controllable. Moreover, it is shown that, for distributed controls with compact support, the exact controllability problem is not possible.
△ Less
Submitted 10 April, 2012;
originally announced April 2012.
-
On the Galois Theory of Grothendieck
Authors:
E. J. Dubuc,
C. Sanchez de la Vega
Abstract:
In this paper we deal with Grothendieck's interpretation of Artin's interpretation of Galois's Galois Theory (and its natural relation with the fundamental group and the theory of coverings) as he developed it in Expose V, section 4, ``Conditions axiomatiques d'une theorie de Galois'' in the SGA1 1960/61.
This is a beautiful piece of mathematics very rich in categorical concepts, and goes much…
▽ More
In this paper we deal with Grothendieck's interpretation of Artin's interpretation of Galois's Galois Theory (and its natural relation with the fundamental group and the theory of coverings) as he developed it in Expose V, section 4, ``Conditions axiomatiques d'une theorie de Galois'' in the SGA1 1960/61.
This is a beautiful piece of mathematics very rich in categorical concepts, and goes much beyond the original Galois's scope (just as Galois went much further than the non resubility of the quintic equation). We show explicitly how Grothendieck's abstraction corresponds to Galois work.
We introduce some axioms and prove a theorem of characterization of the category (topos) of actions of a discrete group. This theorem corresponds exactly to Galois fundamental result. The theorem of Grothendieck characterizes the category (topos) of continuous actions of a profinite topological group. We develop a proof of this result as a "passage into the limit'' (in an inverse limit of topoi) of our theorem of characterization of the topos of actions of a discrete group. We deal with the inverse limit of topoi just working with an ordinary filtered colimit (or union) of the small categories which are their (respective) sites of definition.
We do not consider generalizations of Grothendieck's work, except by commenting briefly in the last section how to deal with the prodiscrete (not profinite) case. We also mention the work of Joyal-Tierney, which falls naturally in our discussion.
There is no need of advanced knowledge of category theory to read this paper, exept for the comments in the last section.
△ Less
Submitted 14 September, 2000;
originally announced September 2000.
