-
This Time is Different: An Observability Perspective on Time Series Foundation Models
Authors:
Ben Cohen,
Emaad Khwaja,
Youssef Doubli,
Salahidine Lemaachi,
Chris Lettieri,
Charles Masson,
Hugo Miccinilli,
Elise Ramé,
Qiqi Ren,
Afshin Rostamizadeh,
Jean Ogier du Terrail,
Anna-Monica Toon,
Kan Wang,
Stephan Xie,
Zongzhe Xu,
Viktoriya Zhukova,
David Asker,
Ameet Talwalkar,
Othmane Abou-Amal
Abstract:
We introduce Toto, a time series forecasting foundation model with 151 million parameters. Toto uses a modern decoder-only architecture coupled with architectural innovations designed to account for specific challenges found in multivariate observability time series data. Toto's pre-training corpus is a mixture of observability data, open datasets, and synthetic data, and is 4-10$\times$ larger th…
▽ More
We introduce Toto, a time series forecasting foundation model with 151 million parameters. Toto uses a modern decoder-only architecture coupled with architectural innovations designed to account for specific challenges found in multivariate observability time series data. Toto's pre-training corpus is a mixture of observability data, open datasets, and synthetic data, and is 4-10$\times$ larger than those of leading time series foundation models. Additionally, we introduce BOOM, a large-scale benchmark consisting of 350 million observations across 2,807 real-world time series. For both Toto and BOOM, we source observability data exclusively from Datadog's own telemetry and internal observability metrics. Extensive evaluations demonstrate that Toto achieves state-of-the-art performance on both BOOM and on established general purpose time series forecasting benchmarks. Toto's model weights, inference code, and evaluation scripts, as well as BOOM's data and evaluation code, are all available as open source under the Apache 2.0 License available at https://huggingface.co/Datadog/Toto-Open-Base-1.0 and https://github.com/DataDog/toto.
△ Less
Submitted 20 May, 2025;
originally announced May 2025.
-
Toto: Time Series Optimized Transformer for Observability
Authors:
Ben Cohen,
Emaad Khwaja,
Kan Wang,
Charles Masson,
Elise Ramé,
Youssef Doubli,
Othmane Abou-Amal
Abstract:
This technical report describes the Time Series Optimized Transformer for Observability (Toto), a new state of the art foundation model for time series forecasting developed by Datadog. In addition to advancing the state of the art on generalized time series benchmarks in domains such as electricity and weather, this model is the first general-purpose time series forecasting foundation model to be…
▽ More
This technical report describes the Time Series Optimized Transformer for Observability (Toto), a new state of the art foundation model for time series forecasting developed by Datadog. In addition to advancing the state of the art on generalized time series benchmarks in domains such as electricity and weather, this model is the first general-purpose time series forecasting foundation model to be specifically tuned for observability metrics.
Toto was trained on a dataset of one trillion time series data points, the largest among all currently published time series foundation models. Alongside publicly available time series datasets, 75% of the data used to train Toto consists of fully anonymous numerical metric data points from the Datadog platform.
In our experiments, Toto outperforms existing time series foundation models on observability data. It does this while also excelling at general-purpose forecasting tasks, achieving state-of-the-art zero-shot performance on multiple open benchmark datasets.
△ Less
Submitted 11 July, 2024; v1 submitted 10 July, 2024;
originally announced July 2024.
-
On the shape of air-liquid interfaces with surface tension that bound rigidly-rotating liquids in partially filled containers
Authors:
Enrique Ramé,
Steven J. Weinstein,
Nathaniel S. Barlow
Abstract:
The interface shape of a fluid in rigid body rotation about its axis and partially filling the container is often the subject of a homework problem in the first graduate fluids class. In that problem, surface tension is neglected, the interface shape is parabolic and the contact angle boundary condition is not satisfied in general. When surface tension is accounted for, the shapes exhibit much ric…
▽ More
The interface shape of a fluid in rigid body rotation about its axis and partially filling the container is often the subject of a homework problem in the first graduate fluids class. In that problem, surface tension is neglected, the interface shape is parabolic and the contact angle boundary condition is not satisfied in general. When surface tension is accounted for, the shapes exhibit much richer dependencies as a function of rotation velocity. We analyze steady interface shapes in rotating right-circular cylindrical containers under rigid body rotation in zero gravity. We pay especial attention to shapes near criticality, in which the interface, or part thereof, becomes straight and parallel to the axis of rotation at certain specific rotational speeds. We examine geometries where the container is axially infinite and derive properties of their solutions. We then examine in detail two special cases of menisci in a cylindrical container: a meniscus spanning the cross section; and a meniscus forming a bubble. In each case we develop exact solutions for the respective axial lengths as infinite series in powers of appropriate rotation parameters; and we find the respective asymptotic behaviors as the shapes approach their critical configuration. Finally we apply the method of asymptotic approximants to yield analytical expressions for the axial lengths of menisci over the whole range of rotation speeds. In this application, the analytical solution is employed to examine errors introduced by the assumption that the interface is a right circular cylinder; this assumption is key to the spinning bubble method used to measure surface tension.
△ Less
Submitted 10 September, 2021; v1 submitted 16 February, 2021;
originally announced February 2021.
