-
Optimizing Multi-Stage Language Models for Effective Text Retrieval
Authors:
Quang Hoang Trung,
Le Trung Hoang,
Nguyen Van Hoang Phuc
Abstract:
Efficient text retrieval is critical for applications such as legal document analysis, particularly in specialized contexts like Japanese legal systems. Existing retrieval methods often underperform in such domain-specific scenarios, necessitating tailored approaches. In this paper, we introduce a novel two-phase text retrieval pipeline optimized for Japanese legal datasets. Our method leverages a…
▽ More
Efficient text retrieval is critical for applications such as legal document analysis, particularly in specialized contexts like Japanese legal systems. Existing retrieval methods often underperform in such domain-specific scenarios, necessitating tailored approaches. In this paper, we introduce a novel two-phase text retrieval pipeline optimized for Japanese legal datasets. Our method leverages advanced language models to achieve state-of-the-art performance, significantly improving retrieval efficiency and accuracy. To further enhance robustness and adaptability, we incorporate an ensemble model that integrates multiple retrieval strategies, resulting in superior outcomes across diverse tasks. Extensive experiments validate the effectiveness of our approach, demonstrating strong performance on both Japanese legal datasets and widely recognized benchmarks like MS-MARCO. Our work establishes new standards for text retrieval in domain-specific and general contexts, providing a comprehensive solution for addressing complex queries in legal and multilingual environments.
△ Less
Submitted 26 December, 2024;
originally announced December 2024.
-
Adaptive Two-Phase Finetuning LLMs for Japanese Legal Text Retrieval
Authors:
Quang Hoang Trung,
Nguyen Van Hoang Phuc,
Le Trung Hoang,
Quang Huu Hieu,
Vo Nguyen Le Duy
Abstract:
Text Retrieval (TR) involves finding and retrieving text-based content relevant to a user's query from a large repository, with applications in real-world scenarios such as legal document retrieval. While most existing studies focus on English, limited work addresses Japanese contexts. In this paper, we introduce a new dataset specifically designed for Japanese legal contexts and propose a novel t…
▽ More
Text Retrieval (TR) involves finding and retrieving text-based content relevant to a user's query from a large repository, with applications in real-world scenarios such as legal document retrieval. While most existing studies focus on English, limited work addresses Japanese contexts. In this paper, we introduce a new dataset specifically designed for Japanese legal contexts and propose a novel two-phase pipeline tailored to this domain.
In the first phase, the model learns a broad understanding of global contexts, enhancing its generalization and adaptability to diverse queries. In the second phase, the model is fine-tuned to address complex queries specific to legal scenarios. Extensive experiments are conducted to demonstrate the superior performance of our method, which outperforms existing baselines.
Furthermore, our pipeline proves effective in English contexts, surpassing comparable baselines on the MS MARCO dataset. We have made our code publicly available on GitHub, and the model checkpoints are accessible via HuggingFace.
△ Less
Submitted 3 December, 2024;
originally announced December 2024.
-
Asymptotic Expansions in Time for Rotating Incompressible Viscous Fluids
Authors:
Luan T. Hoang,
Edriss S. Titi
Abstract:
We study the three-dimensional Navier--Stokes equations of rotating incompressible viscous fluids with periodic boundary conditions. The asymptotic expansions, as time goes to infinity, are derived in all Gevrey spaces for any Leray-Hopf weak solutions in terms of oscillating, exponentially decaying functions. The results are established for all non-zero rotation speeds, and for both cases with an…
▽ More
We study the three-dimensional Navier--Stokes equations of rotating incompressible viscous fluids with periodic boundary conditions. The asymptotic expansions, as time goes to infinity, are derived in all Gevrey spaces for any Leray-Hopf weak solutions in terms of oscillating, exponentially decaying functions. The results are established for all non-zero rotation speeds, and for both cases with and without the zero spatial average of the solutions. Our method makes use of the Poincaré waves to rewrite the equations, and then implements the Gevrey norm techniques to deal with the resulting time-dependent bi-linear form. Special solutions are also found which form infinite dimensional invariant linear manifolds.
△ Less
Submitted 30 June, 2020; v1 submitted 21 October, 2019;
originally announced October 2019.
-
Asymptotic expansion for solutions of the Navier-Stokes equations with non-potential body forces
Authors:
Luan T. Hoang,
Vincent R. Martinez
Abstract:
We study the long-time behavior of spatially periodic solutions of the Navier-Stokes equations in the three-dimensional space. The body force is assumed to possess an asymptotic expansion or, resp., finite asymptotic approximation, in either Sobolev or Gevrey spaces, as time tends to infinity, in terms of polynomial and decaying exponential functions of time. We establish an asymptotic expansion,…
▽ More
We study the long-time behavior of spatially periodic solutions of the Navier-Stokes equations in the three-dimensional space. The body force is assumed to possess an asymptotic expansion or, resp., finite asymptotic approximation, in either Sobolev or Gevrey spaces, as time tends to infinity, in terms of polynomial and decaying exponential functions of time. We establish an asymptotic expansion, or resp., finite asymptotic approximation, of the same type for the Leray-Hopf weak solutions. This extends the previous results, obtained in the case of potential forces, to the non-potential force case, where the body force may have different levels of regularity and asymptotic approximation. In fact, our analysis identifies precisely how the structure of the force influences the asymptotic behavior of the solutions.
△ Less
Submitted 21 November, 2017; v1 submitted 25 July, 2017;
originally announced July 2017.
-
Continuity of pullback and uniform attractors
Authors:
Luan T. Hoang,
Eric J. Olson,
James C. Robinson
Abstract:
We study the continuity of pullback and uniform attractors for non-autonomous dynamical systems with respect to perturbations of a parameter. Consider a family of dynamical systems parameterised by a complete metric space $Λ$ such that for each $λ\inΛ$ there exists a unique pullback attractor $\mathcal A_λ(t)$. Using the theory of Baire category we show under natural conditions that there exists a…
▽ More
We study the continuity of pullback and uniform attractors for non-autonomous dynamical systems with respect to perturbations of a parameter. Consider a family of dynamical systems parameterised by a complete metric space $Λ$ such that for each $λ\inΛ$ there exists a unique pullback attractor $\mathcal A_λ(t)$. Using the theory of Baire category we show under natural conditions that there exists a residual set $Λ_*\subseteqΛ$ such that for every $t\in\mathbb R$ the function $λ\mapsto\mathcal A_λ(t)$ is continuous at each $λ\inΛ_*$ with respect to the Hausdorff metric. Similarly, given a family of uniform attractors $\mathbb A_λ$, there is a residual set at which the map $λ\mapsto\mathbb A_λ$ is continuous. We also introduce notions of equi-attraction suitable for pullback and uniform attractors and then show when $Λ$ is compact that the continuity of pullback attractors and uniform attractors with respect to $λ$ is equivalent to pullback equi-attraction and, respectively, uniform equi-attraction. These abstract results are then illustrated in the context of the Lorenz equations and the two-dimensional Navier-Stokes equations.
△ Less
Submitted 26 February, 2017; v1 submitted 27 January, 2016;
originally announced January 2016.
-
Asymptotic expansion in Gevrey spaces for solutions of Navier-Stokes equations
Authors:
Luan T. Hoang,
Vincent R. Martinez
Abstract:
In this paper, we study the asymptotic behavior of solutions to the three-dimensional incompressible Navier-Stokes equations (NSE) with periodic boundary conditions and potential body forces. In particular, we prove that the Foias-Saut asymptotic expansion for the regular solutions of the NSE in fact holds in {\textit{all Gevrey classes}}. This strengthens the previous result obtained in Sobolev s…
▽ More
In this paper, we study the asymptotic behavior of solutions to the three-dimensional incompressible Navier-Stokes equations (NSE) with periodic boundary conditions and potential body forces. In particular, we prove that the Foias-Saut asymptotic expansion for the regular solutions of the NSE in fact holds in {\textit{all Gevrey classes}}. This strengthens the previous result obtained in Sobolev spaces by Foias-Saut. By using the Gevrey-norm technique of Foias-Temam, the proof of our improved result simplifies the original argument of Foias-Saut, thereby, increasing its adaptability to other dissipative systems. Moreover, the expansion is extended to all Leray-Hopf weak solutions.
△ Less
Submitted 28 April, 2017; v1 submitted 11 November, 2015;
originally announced November 2015.
-
Properties of Generalized Forchheimer Flows in Porous Media
Authors:
Luan T. Hoang,
Thinh T. Kieu,
Tuoc V. Phan
Abstract:
The nonlinear Forchheimer equations are used to describe the dynamics of fluid flows in porous media when Darcy's law is not applicable. In this article, we consider the generalized Forchheimer flows for slightly compressible fluids and study the initial boundary value problem for the resulting degenerate parabolic equation for pressure with the time-dependent flux boundary condition. We estimate…
▽ More
The nonlinear Forchheimer equations are used to describe the dynamics of fluid flows in porous media when Darcy's law is not applicable. In this article, we consider the generalized Forchheimer flows for slightly compressible fluids and study the initial boundary value problem for the resulting degenerate parabolic equation for pressure with the time-dependent flux boundary condition. We estimate $L^\infty$-norm for pressure and its time derivative, as well as other Lebesgue norms for its gradient and second spatial derivatives. The asymptotic estimates as time tends to infinity are emphasized. We then show that the solution (in interior $L^\infty$-norms) and its gradient (in interior $L^{2-δ}$-norms) depend continuously on the initial and boundary data, and coefficients of the Forchheimer polynomials. These are proved for both finite time intervals and time infinity. The De Giorgi and Ladyzhenskaya-Uraltseva iteration techniques are combined with uniform Gronwall-type estimates, specific monotonicity properties, suitable parabolic Sobolev embeddings and a new fast geometric convergence result.
△ Less
Submitted 27 May, 2014;
originally announced May 2014.
-
Interior Estimates for Generalized Forchheimer Flows of Slightly Compressible Fluids
Authors:
Luan T. Hoang,
Thinh T. Kieu
Abstract:
The generalized Forchheimer flows are studied for slightly compressible fluids in porous media with time-dependent Dirichlet boundary data for the pressure. No restrictions on the degree of the Forchheimer polynomial are imposed. We derive, for all time, the interior $L^\infty$-estimates for the pressure and its partial derivatives, and the interior $L^2$-estimates for its Hessian. The De Giorgi a…
▽ More
The generalized Forchheimer flows are studied for slightly compressible fluids in porous media with time-dependent Dirichlet boundary data for the pressure. No restrictions on the degree of the Forchheimer polynomial are imposed. We derive, for all time, the interior $L^\infty$-estimates for the pressure and its partial derivatives, and the interior $L^2$-estimates for its Hessian. The De Giorgi and Ladyzhenskaya-Uraltseva iteration techniques are used taking into account the special structures of the equations for both pressure and its gradient. These are combined with the uniform Gronwall-type bounds in establishing the asymptotic estimates when time tends to infinity.
△ Less
Submitted 1 October, 2015; v1 submitted 25 April, 2014;
originally announced April 2014.
-
Self-diffusion and cross-diffusion equations: $w^{1,p}$-estimates and global existence of smooth solutions
Authors:
Luan T. Hoang,
Tuoc V. Phan,
Truyen V. Nguyen
Abstract:
We investigate the global time existence of smooth solutions for the Shigesada-Kawasaki-Teramoto system of cross-diffusion equations of two competing species in population dynamics. If there are self-diffusion in one species and no cross-diffusion in the other, we show that the system has a unique smooth solution for all time in bounded domains of any dimension. We obtain this result by deriving g…
▽ More
We investigate the global time existence of smooth solutions for the Shigesada-Kawasaki-Teramoto system of cross-diffusion equations of two competing species in population dynamics. If there are self-diffusion in one species and no cross-diffusion in the other, we show that the system has a unique smooth solution for all time in bounded domains of any dimension. We obtain this result by deriving global $W^{1,p}$-estimates of Calderón-Zygmund type for a class of nonlinear reaction-diffusion equations with self-diffusion. These estimates are achieved by employing Caffarelli-Peral perturbation technique together with a new two-parameter scaling argument.
△ Less
Submitted 26 November, 2013;
originally announced November 2013.
-
A family of steady two-phase generalized Forchheimer flows and their linear stability analysis
Authors:
Luan T. Hoang,
Akif Ibragimov,
Thinh T. Kieu
Abstract:
We model multi-dimensional two-phase flows of incompressible fluids in porous media using generalized Forchheimer equations and the capillary pressure. Firstly, we find a family of steady state solutions whose saturation and pressure are radially symmetric and velocities are rotation-invariant. Their properties are investigated based on relations between the capillary pressure, each phase's relati…
▽ More
We model multi-dimensional two-phase flows of incompressible fluids in porous media using generalized Forchheimer equations and the capillary pressure. Firstly, we find a family of steady state solutions whose saturation and pressure are radially symmetric and velocities are rotation-invariant. Their properties are investigated based on relations between the capillary pressure, each phase's relative permeability and Forchheimer polynomial. Secondly, we analyze the linear stability of those steady states.
The linearized system is derived and reduced to a parabolic equation for the saturation. This equation has a special structure depending on the steady states which we exploit to prove two new forms of the lemma of growth of Landis-type in both bounded and unbounded domains. Using these lemmas, qualitative properties of the solution of the linearized equation are studied in details. In bounded domains, we show that the solution decays exponentially in time. In unbounded domains, in addition to their stability, the solution decays to zero as the spatial variables tend to infinity. The Bernstein
△ Less
Submitted 21 October, 2013;
originally announced October 2013.