-
GPT-4o System Card
Authors:
OpenAI,
:,
Aaron Hurst,
Adam Lerer,
Adam P. Goucher,
Adam Perelman,
Aditya Ramesh,
Aidan Clark,
AJ Ostrow,
Akila Welihinda,
Alan Hayes,
Alec Radford,
Aleksander Mądry,
Alex Baker-Whitcomb,
Alex Beutel,
Alex Borzunov,
Alex Carney,
Alex Chow,
Alex Kirillov,
Alex Nichol,
Alex Paino,
Alex Renzin,
Alex Tachard Passos,
Alexander Kirillov,
Alexi Christakis
, et al. (395 additional authors not shown)
Abstract:
GPT-4o is an autoregressive omni model that accepts as input any combination of text, audio, image, and video, and generates any combination of text, audio, and image outputs. It's trained end-to-end across text, vision, and audio, meaning all inputs and outputs are processed by the same neural network. GPT-4o can respond to audio inputs in as little as 232 milliseconds, with an average of 320 mil…
▽ More
GPT-4o is an autoregressive omni model that accepts as input any combination of text, audio, image, and video, and generates any combination of text, audio, and image outputs. It's trained end-to-end across text, vision, and audio, meaning all inputs and outputs are processed by the same neural network. GPT-4o can respond to audio inputs in as little as 232 milliseconds, with an average of 320 milliseconds, which is similar to human response time in conversation. It matches GPT-4 Turbo performance on text in English and code, with significant improvement on text in non-English languages, while also being much faster and 50\% cheaper in the API. GPT-4o is especially better at vision and audio understanding compared to existing models. In line with our commitment to building AI safely and consistent with our voluntary commitments to the White House, we are sharing the GPT-4o System Card, which includes our Preparedness Framework evaluations. In this System Card, we provide a detailed look at GPT-4o's capabilities, limitations, and safety evaluations across multiple categories, focusing on speech-to-speech while also evaluating text and image capabilities, and measures we've implemented to ensure the model is safe and aligned. We also include third-party assessments on dangerous capabilities, as well as discussion of potential societal impacts of GPT-4o's text and vision capabilities.
△ Less
Submitted 25 October, 2024;
originally announced October 2024.
-
Roadmap for focused ion beam technologies
Authors:
Katja Höflich,
Gerhard Hobler,
Frances I. Allen,
Tom Wirtz,
Gemma Rius,
Lisa McElwee-White,
Arkady V. Krasheninnikov,
Matthias Schmidt,
Ivo Utke,
Nico Klingner,
Markus Osenberg,
Rosa Córdoba,
Flyura Djurabekova,
Ingo Manke,
Philip Moll,
Mariachiara Manoccio,
José Marıa De Teresa,
Lothar Bischoff,
Johann Michler,
Olivier De Castro,
Anne Delobbe,
Peter Dunne,
Oleksandr V. Dobrovolskiy,
Natalie Frese,
Armin Gölzhäuser
, et al. (7 additional authors not shown)
Abstract:
The focused ion beam (FIB) is a powerful tool for the fabrication, modification and characterization of materials down to the nanoscale. Starting with the gallium FIB, which was originally intended for photomask repair in the semiconductor industry, there are now many different types of FIB that are commercially available. These instruments use a range of ion species and are applied broadly in mat…
▽ More
The focused ion beam (FIB) is a powerful tool for the fabrication, modification and characterization of materials down to the nanoscale. Starting with the gallium FIB, which was originally intended for photomask repair in the semiconductor industry, there are now many different types of FIB that are commercially available. These instruments use a range of ion species and are applied broadly in materials science, physics, chemistry, biology, medicine, and even archaeology. The goal of this roadmap is to provide an overview of FIB instrumentation, theory, techniques and applications. By viewing FIB developments through the lens of the various research communities, we aim to identify future pathways for ion source and instrumentation development as well as emerging applications, and the scope for improved understanding of the complex interplay of ion-solid interactions. We intend to provide a guide for all scientists in the field that identifies common research interests and will support future fruitful interactions connecting tool development, experiment and theory. While a comprehensive overview of the field is sought, it is not possible to cover all research related to FIB technologies in detail. We give examples of specific projects within the broader context, referencing original works and previous review articles throughout.
△ Less
Submitted 6 October, 2023; v1 submitted 31 May, 2023;
originally announced May 2023.
-
Synthetic Image Rendering Solves Annotation Problem in Deep Learning Nanoparticle Segmentation
Authors:
Leonid Mill,
David Wolff,
Nele Gerrits,
Patrick Philipp,
Lasse Kling,
Florian Vollnhals,
Andrew Ignatenko,
Christian Jaremenko,
Yixing Huang,
Olivier De Castro,
Jean-Nicolas Audinot,
Inge Nelissen,
Tom Wirtz,
Andreas Maier,
Silke Christiansen
Abstract:
Nanoparticles occur in various environments as a consequence of man-made processes, which raises concerns about their impact on the environment and human health. To allow for proper risk assessment, a precise and statistically relevant analysis of particle characteristics (such as e.g. size, shape and composition) is required that would greatly benefit from automated image analysis procedures. Whi…
▽ More
Nanoparticles occur in various environments as a consequence of man-made processes, which raises concerns about their impact on the environment and human health. To allow for proper risk assessment, a precise and statistically relevant analysis of particle characteristics (such as e.g. size, shape and composition) is required that would greatly benefit from automated image analysis procedures. While deep learning shows impressive results in object detection tasks, its applicability is limited by the amount of representative, experimentally collected and manually annotated training data. Here, we present an elegant, flexible and versatile method to bypass this costly and tedious data acquisition process. We show that using a rendering software allows to generate realistic, synthetic training data to train a state-of-the art deep neural network. Using this approach, we derive a segmentation accuracy that is comparable to man-made annotations for toxicologically relevant metal-oxide nanoparticle ensembles which we chose as examples. Our study paves the way towards the use of deep learning for automated, high-throughput particle detection in a variety of imaging techniques such as microscopies and spectroscopies, for a wide variety of studies and applications, including the detection of plastic micro- and nanoparticles.
△ Less
Submitted 20 November, 2020;
originally announced November 2020.
-
A General Scheme Implicit Force Control for a Flexible-Link Manipulator
Authors:
Cecilia Murrugarra,
Osberth De Castro,
Juan Carlos Grieco,
Gerardo Fernandez
Abstract:
In this paper we propose an implicit force control scheme for a one-link flexible manipulator that interact with a compliant environment. The controller was based in the mathematical model of the manipulator, considering the dynamics of the beam flexible and the gravitational force. With this method, the controller parameters are obtained from the structural parameters of the beam (link) of the ma…
▽ More
In this paper we propose an implicit force control scheme for a one-link flexible manipulator that interact with a compliant environment. The controller was based in the mathematical model of the manipulator, considering the dynamics of the beam flexible and the gravitational force. With this method, the controller parameters are obtained from the structural parameters of the beam (link) of the manipulator. This controller ensure the stability based in the Lyapunov Theory. The controller proposed has two closed loops: the inner loop is a tracking control with gravitational force and vibration frequencies compensation and the outer loop is a implicit force control. To evaluate the performance of the controller, we have considered to three different manipulators (the length, the diameter were modified) and three environments with compliance modified. The results obtained from simulations verify the asymptotic tracking and regulated in position and force respectively and the vibrations suppression of the beam in a finite time.
△ Less
Submitted 13 May, 2017;
originally announced May 2017.
