-
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Authors:
Gemini Team,
Petko Georgiev,
Ving Ian Lei,
Ryan Burnell,
Libin Bai,
Anmol Gulati,
Garrett Tanzer,
Damien Vincent,
Zhufeng Pan,
Shibo Wang,
Soroosh Mariooryad,
Yifan Ding,
Xinyang Geng,
Fred Alcober,
Roy Frostig,
Mark Omernick,
Lexi Walker,
Cosmin Paduraru,
Christina Sorokin,
Andrea Tacchetti,
Colin Gaffney,
Samira Daruki,
Olcan Sercinoglu,
Zach Gleicher,
Juliette Love
, et al. (1112 additional authors not shown)
Abstract:
In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and hours of video and audio. The family includes two new models: (1) an updated Gemini 1.5 Pro, which exceeds the February…
▽ More
In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and hours of video and audio. The family includes two new models: (1) an updated Gemini 1.5 Pro, which exceeds the February version on the great majority of capabilities and benchmarks; (2) Gemini 1.5 Flash, a more lightweight variant designed for efficiency with minimal regression in quality. Gemini 1.5 models achieve near-perfect recall on long-context retrieval tasks across modalities, improve the state-of-the-art in long-document QA, long-video QA and long-context ASR, and match or surpass Gemini 1.0 Ultra's state-of-the-art performance across a broad set of benchmarks. Studying the limits of Gemini 1.5's long-context ability, we find continued improvement in next-token prediction and near-perfect retrieval (>99%) up to at least 10M tokens, a generational leap over existing models such as Claude 3.0 (200k) and GPT-4 Turbo (128k). Finally, we highlight real-world use cases, such as Gemini 1.5 collaborating with professionals on completing their tasks achieving 26 to 75% time savings across 10 different job categories, as well as surprising new capabilities of large language models at the frontier; when given a grammar manual for Kalamang, a language with fewer than 200 speakers worldwide, the model learns to translate English to Kalamang at a similar level to a person who learned from the same content.
△ Less
Submitted 16 December, 2024; v1 submitted 8 March, 2024;
originally announced March 2024.
-
A Database for Research on Detection and Enhancement of Speech Transmitted over HF links
Authors:
Jens Heitkaemper,
Joerg Schmalenstroeer,
Joerg Ullmann,
Valentin Ion,
Reinhold Haeb-Umbach
Abstract:
In this paper we present an open database for the development of detection and enhancement algorithms of speech transmitted over HF radio channels. It consists of audio samples recorded by various receivers at different locations across Europe, all monitoring the same single-sideband modulated transmission from a base station in Paderborn, Germany. Transmitted and received speech signals are preci…
▽ More
In this paper we present an open database for the development of detection and enhancement algorithms of speech transmitted over HF radio channels. It consists of audio samples recorded by various receivers at different locations across Europe, all monitoring the same single-sideband modulated transmission from a base station in Paderborn, Germany. Transmitted and received speech signals are precisely time aligned to offer parallel data for supervised training of deep learning based detection and enhancement algorithms. For the task of speech activity detection two exemplary baseline systems are presented, one based on statistical methods employing a multi-stage Wiener filter with minimum statistics noise floor estimation, and the other relying on a deep learning approach.
△ Less
Submitted 21 July, 2021; v1 submitted 4 June, 2021;
originally announced June 2021.
-
Study of the behaviour of proliferating cells in leukemia modelled by a system of delay differential equations
Authors:
Anca Veronica Ion
Abstract:
For the model of periodic chronic myelogenous leukemia considered by Pujo-Menjouet, Mackey et al., model consisting of two delay differential equations, the equation for the density of so-called "resting cells" was studied from numerical and qualitative point of view in several works. In this paper we focus on the equation for the density of proliferating cells and study it from a qualitative poin…
▽ More
For the model of periodic chronic myelogenous leukemia considered by Pujo-Menjouet, Mackey et al., model consisting of two delay differential equations, the equation for the density of so-called "resting cells" was studied from numerical and qualitative point of view in several works. In this paper we focus on the equation for the density of proliferating cells and study it from a qualitative point of view.
△ Less
Submitted 10 April, 2014; v1 submitted 12 March, 2014;
originally announced March 2014.
-
"An example of Bautin-type bifurcation in a delay differential equation", plus errata
Authors:
Anca Veronica Ion
Abstract:
Some errors contained in the author's previous article "An example of Bautin-type bifurcation in a delay differential equation", JMAA, 329(2007), 777-789, are listed and corrected.
Original abstract: In a previous paper we gave sufficient conditions for a system of delay differential equations to present Bautin-type bifurcation. In the present work we present an example of delay equation that sa…
▽ More
Some errors contained in the author's previous article "An example of Bautin-type bifurcation in a delay differential equation", JMAA, 329(2007), 777-789, are listed and corrected.
Original abstract: In a previous paper we gave sufficient conditions for a system of delay differential equations to present Bautin-type bifurcation. In the present work we present an example of delay equation that satisfies these conditions.
△ Less
Submitted 23 January, 2014;
originally announced January 2014.
-
On the computation of the third order terms of the series defining the center manifold for systems of delay differential equation
Authors:
Anca Veronica Ion
Abstract:
When studying a general system of delay differential equation with a single constant delay, we encounter a certain lack of uniqueness in determining the coefficient of one of the third order terms of the series defining the center manifold. We solve this problem by considering a perturbation of the considered problem, perturbation that allows us to remove the singularity. The result generalizes a…
▽ More
When studying a general system of delay differential equation with a single constant delay, we encounter a certain lack of uniqueness in determining the coefficient of one of the third order terms of the series defining the center manifold. We solve this problem by considering a perturbation of the considered problem, perturbation that allows us to remove the singularity. The result generalizes a similar result obtained for scalar differential equations (J. Dyn. Diff. Eqns., 24/2012).
△ Less
Submitted 10 December, 2013; v1 submitted 22 November, 2013;
originally announced November 2013.
-
Numerical investigation of the Bautin bifurcation in a delay differential equation modeling leukemia
Authors:
Anca Veronica Ion,
Raluca Mihaela Georgescu
Abstract:
In a previous work we investigated the existence of Hopf degenerate bifurcation points for a differential delay equation modeling leukemia and we actually found Hopf points of codimension two for the considered problem. If around the parameters corresponding to such a point we vary two parameters (the considered problem has five parameters), then a Bautin bifurcation should occur. In this work we…
▽ More
In a previous work we investigated the existence of Hopf degenerate bifurcation points for a differential delay equation modeling leukemia and we actually found Hopf points of codimension two for the considered problem. If around the parameters corresponding to such a point we vary two parameters (the considered problem has five parameters), then a Bautin bifurcation should occur. In this work we chose a Hopf point of codimension two for the considered problem and perform numerical integration for parameters chosen in a neighborhood of the bifurcation point parameters. The results show that, indeed, we have a Bautin bifurcation in the chosen point.
△ Less
Submitted 8 August, 2012;
originally announced August 2012.
-
Hopf points of codimension two in a delay differential equation modeling leukemia
Authors:
Anca Veronica Ion,
Raluca Mihaela Georgescu
Abstract:
This paper continues the work contained in two previous papers, devoted to the study of the dynamical system generated by a delay differential equation that models leukemia. Here our aim is to identify degenerate Hopf bifurcation points. By using an approximation of the center manifold, we compute the first Lyapunov coefficient for Hopf bifurcation points. We find by direct computation, in some zo…
▽ More
This paper continues the work contained in two previous papers, devoted to the study of the dynamical system generated by a delay differential equation that models leukemia. Here our aim is to identify degenerate Hopf bifurcation points. By using an approximation of the center manifold, we compute the first Lyapunov coefficient for Hopf bifurcation points. We find by direct computation, in some zones of the parameter space (of biological significance), points where the first Lyapunov coefficient equals zero. For these we compute the second Lyapunov coefficient, that determines the type of the degenerate Hopf bifurcation.
△ Less
Submitted 17 May, 2012;
originally announced May 2012.
-
On the Bautin bifurcation for systems of delay differential equations
Authors:
Anca Veronica Ion
Abstract:
For systems of delay differential equations the Hopf bifurcation was investigated by several authors. The problem we consider here is that of the possibility of emergence of a codimension two bifurcation, namely the Bautin bifurcation, for some of such systems.
For systems of delay differential equations the Hopf bifurcation was investigated by several authors. The problem we consider here is that of the possibility of emergence of a codimension two bifurcation, namely the Bautin bifurcation, for some of such systems.
△ Less
Submitted 7 November, 2011;
originally announced November 2011.
-
New results concerning the stability of equilibria of a delay differential equation modeling leukemia
Authors:
Anca Veronica Ion
Abstract:
The paper is devoted to the study of stability of equilibrium solutions of a delay differential equation that models leukemia. The equation was previously studied in [5] and [6], where the emphasis is put on the numerical study of periodic solutions. Some stability results for the equilibria are also presented in these works, but they are incomplete and contain some errors. Our work aims to comp…
▽ More
The paper is devoted to the study of stability of equilibrium solutions of a delay differential equation that models leukemia. The equation was previously studied in [5] and [6], where the emphasis is put on the numerical study of periodic solutions. Some stability results for the equilibria are also presented in these works, but they are incomplete and contain some errors. Our work aims to complete and to bring corrections to those results. Both Lyapunov first order approximation method and second Lyapunov method are used.
△ Less
Submitted 26 January, 2010;
originally announced January 2010.
-
Transport, magnetic, and structural properties of La$_{0.7}$Ce$_{0.3}$MnO$_3$ thin films. Evidence for hole-doping
Authors:
R. Werner,
C. Raisch,
V. Leca,
V. Ion,
S. Bals,
G. Van Tendeloo,
T. Chassé,
R. Kleiner,
D. Koelle
Abstract:
Cerium-doped manganite thin films were grown epitaxially by pulsed laser deposition at $720 ^\circ$C and oxygen pressure $p_{O_2}=1-25 $Pa and were subjected to different annealing steps. According to x-ray diffraction (XRD) data, the formation of CeO$_2$ as a secondary phase could be avoided for $p_{O_2}\ge 8 $Pa. However, transmission electron microscopy shows the presence of CeO$_2$ nanoclust…
▽ More
Cerium-doped manganite thin films were grown epitaxially by pulsed laser deposition at $720 ^\circ$C and oxygen pressure $p_{O_2}=1-25 $Pa and were subjected to different annealing steps. According to x-ray diffraction (XRD) data, the formation of CeO$_2$ as a secondary phase could be avoided for $p_{O_2}\ge 8 $Pa. However, transmission electron microscopy shows the presence of CeO$_2$ nanoclusters, even in those films which appear to be single phase in XRD. With O$_2$ annealing, the metal-to-insulator transition temperature increases, while the saturation magnetization decreases and stays well below the theoretical value for electron-doped La$_{0.7}$Ce$_{0.3}$MnO$_3$ with mixed Mn$^{3+}$/Mn$^{2+}$ valences. The same trend is observed with decreasing film thickness from 100 to 20 nm, indicating a higher oxygen content for thinner films. Hall measurements on a film which shows a metal-to-insulator transition clearly reveal holes as dominating charge carriers. Combining data from x-ray photoemission spectroscopy, for determination of the oxygen content, and x-ray absorption spectroscopy (XAS), for determination of the hole concentration and cation valences, we find that with increasing oxygen content the hole concentration increases and Mn valences are shifted from 2+ to 4+. The dominating Mn valences in the films are Mn$^{3+}$ and Mn$^{4+}$, and only a small amount of Mn$^{2+}$ ions can be observed by XAS. Mn$^{2+}$ and Ce$^{4+}$ XAS signals obtained in surface-sensitive total electron yield mode are strongly reduced in the bulk-sensitive fluorescence mode, which indicates hole-doping in the bulk for those films which do show a metal-to-insulator transition.
△ Less
Submitted 28 November, 2008;
originally announced November 2008.
