Showing 1–7 of 7 results for author: Le, J

Generative diffusion models from a PDE perspective

Authors: Fei Cao, Kimball Johnston, Thomas Laurent, Justin Le, Sébastien Motsch

Abstract: Diffusion models have become the de facto framework for generating new datasets. The core of these models lies in the ability to reverse a diffusion process in time. The goal of this manuscript is to explain, from a PDE perspective, how this method works and how to derive the PDE governing the reverse dynamics as well as to study its solution analytically. By linking forward and reverse dynamics,… ▽ More Diffusion models have become the de facto framework for generating new datasets. The core of these models lies in the ability to reverse a diffusion process in time. The goal of this manuscript is to explain, from a PDE perspective, how this method works and how to derive the PDE governing the reverse dynamics as well as to study its solution analytically. By linking forward and reverse dynamics, we show that the reverse process's distribution has its support contained within the original distribution. Consequently, diffusion methods, in their analytical formulation, do not inherently regularize the original distribution, and thus, there is no generalization principle. This raises a question: where does generalization arise, given that in practice it does occur? Moreover, we derive an explicit solution to the reverse process's SDE under the assumption that the starting point of the forward process is fixed. This provides a new derivation that links two popular approaches to generative diffusion models: stable diffusion (discrete dynamics) and the score-based approach (continuous dynamics). Finally, we explore the case where the original distribution consists of a finite set of data points. In this scenario, the reverse dynamics are explicit (i.e., the loss function has a clear minimizer), and solving the dynamics fails to generate new samples: the dynamics converge to the original samples. In a sense, solving the minimization problem exactly is "too good for its own good" (i.e., an overfitting regime). △ Less

Submitted 28 January, 2025; originally announced January 2025.

Comments: 30 pages, 10 figures

Generative Modeling with Diffusion

Authors: Justin Le

Abstract: We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in particular apply noise to sample data and then "reverse" this noising process to generate new samples. We will formally define these noising and denoising proces… ▽ More We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in particular apply noise to sample data and then "reverse" this noising process to generate new samples. We will formally define these noising and denoising processes, then present algorithms to train and generate with a diffusion model. Afterward, we will explore a potential application of diffusion models in improving classifier performance on imbalanced data. △ Less

Submitted 11 June, 2025; v1 submitted 14 December, 2024; originally announced December 2024.

Comments: 17 pages with 6 figures

MSC Class: 62-02

Deriving Milnor's theorem on pullback rings

Authors: Xiao-Wu Chen, Jue Le

Abstract: The classical theorem of Milnor on pullback rings states that the category of projective modules over a pullback ring is equivalent to a certain category of gluing triples consisting of projective modules. We prove an analogous result on the level of derived categories, where the equivalence has to be replaced by an epivalence. The classical theorem of Milnor on pullback rings states that the category of projective modules over a pullback ring is equivalent to a certain category of gluing triples consisting of projective modules. We prove an analogous result on the level of derived categories, where the equivalence has to be replaced by an epivalence. △ Less

Submitted 13 April, 2020; originally announced April 2020.

Comments: Any comments are welcome!

Recollements, comma categories and morphic enhancements

Authors: Xiao-Wu Chen, Jue Le

Abstract: For each recollement of triangulated categories, there is an epivalence between the middle category and the comma category associated to a triangle functor from the category on the right to the category on the left. For a morphic enhancement of a triangulated category $\mathcal{T}$, there are three explicit ideals of the enhancing category, whose corresponding factor categories are all equivalent… ▽ More For each recollement of triangulated categories, there is an epivalence between the middle category and the comma category associated to a triangle functor from the category on the right to the category on the left. For a morphic enhancement of a triangulated category $\mathcal{T}$, there are three explicit ideals of the enhancing category, whose corresponding factor categories are all equivalent to the module category over $\mathcal{T}$. Examples related to inflation categories and weighted projective lines are discussed. △ Less

Submitted 24 May, 2019; originally announced May 2019.

Comments: all comments are welcome!

Journal ref: Proceedings of the Royal Society of Edinburgh Section A: Mathematics, 152 (3) (2022), 567-591

The Auslander-Reiten duality via morphisms determined by objects

Authors: Pengjie Jiao, Jue Le

Abstract: Given an exact category $\mathcal{C}$, we denote by $\mathcal{C}_l$ the smallest additive subcategory containing injectives and indecomposable objects which appear as the first term of an almost split conflation. We prove that a deflation is right determined by some object if and only if its intrinsic kernel lies in $\mathcal{C}_l$. We give characterizations for $\mathcal{C}$ having Auslander-Reit… ▽ More Given an exact category $\mathcal{C}$, we denote by $\mathcal{C}_l$ the smallest additive subcategory containing injectives and indecomposable objects which appear as the first term of an almost split conflation. We prove that a deflation is right determined by some object if and only if its intrinsic kernel lies in $\mathcal{C}_l$. We give characterizations for $\mathcal{C}$ having Auslander-Reiten duality. △ Less

Submitted 7 March, 2018; v1 submitted 8 December, 2016; originally announced December 2016.

Comments: 12 pages

MSC Class: 18E10; 16G70

Journal ref: Journal of Pure and Applied Algebra, 222 (2018), 807-817

A note on morphisms determined by objects

Authors: Xiao-Wu Chen, Jue Le

Abstract: We prove that a Hom-finite additive category having determined morphisms on both sides is a dualizing variety. This complements a result by Krause. We prove that in a Hom-finite abelian category having Serre duality, a morphism is right determined by some object if and only if it is an epimorphism. We give a characterization to abelian categories having Serre duality via determined morphisms. We prove that a Hom-finite additive category having determined morphisms on both sides is a dualizing variety. This complements a result by Krause. We prove that in a Hom-finite abelian category having Serre duality, a morphism is right determined by some object if and only if it is an epimorphism. We give a characterization to abelian categories having Serre duality via determined morphisms. △ Less

Submitted 7 November, 2013; originally announced November 2013.

Journal ref: Journal of Algebra, 428 (2015), 138-148

The Auslander-Reiten formula for complexes of modules

Authors: Henning Krause, Jue Le

Abstract: An Auslander-Reiten formula for complexes of modules is presented. This formula contains as a special case the classical Auslander Reiten formula. The Auslander-Reiten translate of a complex is described explicitly, and various applications are discussed. An Auslander-Reiten formula for complexes of modules is presented. This formula contains as a special case the classical Auslander Reiten formula. The Auslander-Reiten translate of a complex is described explicitly, and various applications are discussed. △ Less

Submitted 29 December, 2004; v1 submitted 4 December, 2004; originally announced December 2004.

Comments: 14 pages

MSC Class: 18E30; 18G10; 16G70