-
International AI Safety Report
Authors:
Yoshua Bengio,
Sören Mindermann,
Daniel Privitera,
Tamay Besiroglu,
Rishi Bommasani,
Stephen Casper,
Yejin Choi,
Philip Fox,
Ben Garfinkel,
Danielle Goldfarb,
Hoda Heidari,
Anson Ho,
Sayash Kapoor,
Leila Khalatbari,
Shayne Longpre,
Sam Manning,
Vasilios Mavroudis,
Mantas Mazeika,
Julian Michael,
Jessica Newman,
Kwan Yee Ng,
Chinasa T. Okolo,
Deborah Raji,
Girish Sastry,
Elizabeth Seger
, et al. (71 additional authors not shown)
Abstract:
The first International AI Safety Report comprehensively synthesizes the current evidence on the capabilities, risks, and safety of advanced AI systems. The report was mandated by the nations attending the AI Safety Summit in Bletchley, UK. Thirty nations, the UN, the OECD, and the EU each nominated a representative to the report's Expert Advisory Panel. A total of 100 AI experts contributed, repr…
▽ More
The first International AI Safety Report comprehensively synthesizes the current evidence on the capabilities, risks, and safety of advanced AI systems. The report was mandated by the nations attending the AI Safety Summit in Bletchley, UK. Thirty nations, the UN, the OECD, and the EU each nominated a representative to the report's Expert Advisory Panel. A total of 100 AI experts contributed, representing diverse perspectives and disciplines. Led by the report's Chair, these independent experts collectively had full discretion over the report's content.
△ Less
Submitted 29 January, 2025;
originally announced January 2025.
-
How will advanced AI systems impact democracy?
Authors:
Christopher Summerfield,
Lisa Argyle,
Michiel Bakker,
Teddy Collins,
Esin Durmus,
Tyna Eloundou,
Iason Gabriel,
Deep Ganguli,
Kobi Hackenburg,
Gillian Hadfield,
Luke Hewitt,
Saffron Huang,
Helene Landemore,
Nahema Marchal,
Aviv Ovadya,
Ariel Procaccia,
Mathias Risse,
Bruce Schneier,
Elizabeth Seger,
Divya Siddarth,
Henrik Skaug Sætra,
MH Tessler,
Matthew Botvinick
Abstract:
Advanced AI systems capable of generating humanlike text and multimodal content are now widely available. In this paper, we discuss the impacts that generative artificial intelligence may have on democratic processes. We consider the consequences of AI for citizens' ability to make informed choices about political representatives and issues (epistemic impacts). We ask how AI might be used to desta…
▽ More
Advanced AI systems capable of generating humanlike text and multimodal content are now widely available. In this paper, we discuss the impacts that generative artificial intelligence may have on democratic processes. We consider the consequences of AI for citizens' ability to make informed choices about political representatives and issues (epistemic impacts). We ask how AI might be used to destabilise or support democratic mechanisms like elections (material impacts). Finally, we discuss whether AI will strengthen or weaken democratic principles (foundational impacts). It is widely acknowledged that new AI systems could pose significant challenges for democracy. However, it has also been argued that generative AI offers new opportunities to educate and learn from citizens, strengthen public discourse, help people find common ground, and to reimagine how democracies might work better.
△ Less
Submitted 27 August, 2024;
originally announced September 2024.
-
Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectives
Authors:
Elizabeth Seger,
Noemi Dreksler,
Richard Moulange,
Emily Dardaman,
Jonas Schuett,
K. Wei,
Christoph Winter,
Mackenzie Arnold,
Seán Ó hÉigeartaigh,
Anton Korinek,
Markus Anderljung,
Ben Bucknall,
Alan Chan,
Eoghan Stafford,
Leonie Koessler,
Aviv Ovadya,
Ben Garfinkel,
Emma Bluemke,
Michael Aird,
Patrick Levermore,
Julian Hazell,
Abhishek Gupta
Abstract:
Recent decisions by leading AI labs to either open-source their models or to restrict access to their models has sparked debate about whether, and how, increasingly capable AI models should be shared. Open-sourcing in AI typically refers to making model architecture and weights freely and publicly accessible for anyone to modify, study, build on, and use. This offers advantages such as enabling ex…
▽ More
Recent decisions by leading AI labs to either open-source their models or to restrict access to their models has sparked debate about whether, and how, increasingly capable AI models should be shared. Open-sourcing in AI typically refers to making model architecture and weights freely and publicly accessible for anyone to modify, study, build on, and use. This offers advantages such as enabling external oversight, accelerating progress, and decentralizing control over AI development and use. However, it also presents a growing potential for misuse and unintended consequences. This paper offers an examination of the risks and benefits of open-sourcing highly capable foundation models. While open-sourcing has historically provided substantial net benefits for most software and AI development processes, we argue that for some highly capable foundation models likely to be developed in the near future, open-sourcing may pose sufficiently extreme risks to outweigh the benefits. In such a case, highly capable foundation models should not be open-sourced, at least not initially. Alternative strategies, including non-open-source model sharing options, are explored. The paper concludes with recommendations for developers, standard-setting bodies, and governments for establishing safe and responsible model sharing practices and preserving open-source benefits where safe.
△ Less
Submitted 29 September, 2023;
originally announced November 2023.
-
Democratising AI: Multiple Meanings, Goals, and Methods
Authors:
Elizabeth Seger,
Aviv Ovadya,
Ben Garfinkel,
Divya Siddarth,
Allan Dafoe
Abstract:
Numerous parties are calling for the democratisation of AI, but the phrase is used to refer to a variety of goals, the pursuit of which sometimes conflict. This paper identifies four kinds of AI democratisation that are commonly discussed: (1) the democratisation of AI use, (2) the democratisation of AI development, (3) the democratisation of AI profits, and (4) the democratisation of AI governanc…
▽ More
Numerous parties are calling for the democratisation of AI, but the phrase is used to refer to a variety of goals, the pursuit of which sometimes conflict. This paper identifies four kinds of AI democratisation that are commonly discussed: (1) the democratisation of AI use, (2) the democratisation of AI development, (3) the democratisation of AI profits, and (4) the democratisation of AI governance. Numerous goals and methods of achieving each form of democratisation are discussed. The main takeaway from this paper is that AI democratisation is a multifarious and sometimes conflicting concept that should not be conflated with improving AI accessibility. If we want to move beyond ambiguous commitments to democratising AI, to productive discussions of concrete policies and trade-offs, then we need to recognise the principal role of the democratisation of AI governance in navigating tradeoffs and risks across decisions around use, development, and profits.
△ Less
Submitted 7 August, 2023; v1 submitted 22 March, 2023;
originally announced March 2023.
-
Hot and Cold QCD White Paper from ALICE-USA: Input for 2023 U.S. Long Range Plan for Nuclear Science
Authors:
N. Alizadehvandchali,
N. Apadula,
M. Arslandok,
C. Beattie,
R. Bellwied,
J. T. Blair,
F. Bock,
H. Bossi,
A. Bylinkin,
H. Caines,
I. Chakaberia,
M. Cherney,
T. M. Cormier,
R. Cruz-Torres,
P. Dhankher,
D. U. Dixit,
R. J. Ehlers,
W. Fan,
M. Fasel,
F. Flor,
A. N. Flores,
D. R. Gangadharan,
E. Garcia-Solis,
A. Gautam,
E. Glimos
, et al. (58 additional authors not shown)
Abstract:
The ALICE-USA collaboration presents its plans for the 2023 U.S. Long Range Plan for Nuclear Science.
The ALICE-USA collaboration presents its plans for the 2023 U.S. Long Range Plan for Nuclear Science.
△ Less
Submitted 1 December, 2022;
originally announced December 2022.
-
Upgrade of Hardware Controls for the STAR Experiment at RHIC
Authors:
Jaroslav Adam,
Michael G. Cherney,
Joey D'Alesio,
Emma Dufresne,
Lukáš Holub,
Janet E. Seger,
David Tlustý
Abstract:
The STAR experiment has been delivering significant physics results for more than 20 years. Stable operation of the experiment was achieved by using a robust controls system based on the Experimental Physics and Industrial Control System (EPICS). Now an object-oriented approach with Python libraries, adapted for EPICS software, is going to replace the procedural-based EPICS C libraries previously…
▽ More
The STAR experiment has been delivering significant physics results for more than 20 years. Stable operation of the experiment was achieved by using a robust controls system based on the Experimental Physics and Industrial Control System (EPICS). Now an object-oriented approach with Python libraries, adapted for EPICS software, is going to replace the procedural-based EPICS C libraries previously used at STAR. Advantages of the new approach include stability of operation, code reduction and straightforward project documentation. The first two sections of this paper introduce the STAR experiment, give an overview of the EPICS architecture, and present the use of Python for controls software. Specific examples, as well as upgrades of user interfaces, are outlined in the following sections.
△ Less
Submitted 16 March, 2021;
originally announced March 2021.
-
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
Authors:
Miles Brundage,
Shahar Avin,
Jasmine Wang,
Haydn Belfield,
Gretchen Krueger,
Gillian Hadfield,
Heidy Khlaaf,
Jingying Yang,
Helen Toner,
Ruth Fong,
Tegan Maharaj,
Pang Wei Koh,
Sara Hooker,
Jade Leung,
Andrew Trask,
Emma Bluemke,
Jonathan Lebensold,
Cullen O'Keefe,
Mark Koren,
Théo Ryffel,
JB Rubinovitz,
Tamay Besiroglu,
Federica Carugati,
Jack Clark,
Peter Eckersley
, et al. (34 additional authors not shown)
Abstract:
With the recent wave of progress in artificial intelligence (AI) has come a growing awareness of the large-scale impacts of AI systems, and recognition that existing regulations and norms in industry and academia are insufficient to ensure responsible AI development. In order for AI developers to earn trust from system users, customers, civil society, governments, and other stakeholders that they…
▽ More
With the recent wave of progress in artificial intelligence (AI) has come a growing awareness of the large-scale impacts of AI systems, and recognition that existing regulations and norms in industry and academia are insufficient to ensure responsible AI development. In order for AI developers to earn trust from system users, customers, civil society, governments, and other stakeholders that they are building AI responsibly, they will need to make verifiable claims to which they can be held accountable. Those outside of a given organization also need effective means of scrutinizing such claims. This report suggests various steps that different stakeholders can take to improve the verifiability of claims made about AI systems and their associated development processes, with a focus on providing evidence about the safety, security, fairness, and privacy protection of AI systems. We analyze ten mechanisms for this purpose--spanning institutions, software, and hardware--and make recommendations aimed at implementing, exploring, or improving those mechanisms.
△ Less
Submitted 20 April, 2020; v1 submitted 15 April, 2020;
originally announced April 2020.
-
A next-generation LHC heavy-ion experiment
Authors:
D. Adamová,
G. Aglieri Rinella,
M. Agnello,
Z. Ahammed,
D. Aleksandrov,
A. Alici,
A. Alkin,
T. Alt,
I. Altsybeev,
D. Andreou,
A. Andronic,
F. Antinori,
P. Antonioli,
H. Appelshäuser,
R. Arnaldi,
I. C. Arsene,
M. Arslandok,
R. Averbeck,
M. D. Azmi,
X. Bai,
R. Bailhache,
R. Bala,
L. Barioglio,
G. G. Barnaföldi,
L. S. Barnby
, et al. (374 additional authors not shown)
Abstract:
The present document discusses plans for a compact, next-generation multi-purpose detector at the LHC as a follow-up to the present ALICE experiment. The aim is to build a nearly massless barrel detector consisting of truly cylindrical layers based on curved wafer-scale ultra-thin silicon sensors with MAPS technology, featuring an unprecedented low material budget of 0.05% X$_0$ per layer, with th…
▽ More
The present document discusses plans for a compact, next-generation multi-purpose detector at the LHC as a follow-up to the present ALICE experiment. The aim is to build a nearly massless barrel detector consisting of truly cylindrical layers based on curved wafer-scale ultra-thin silicon sensors with MAPS technology, featuring an unprecedented low material budget of 0.05% X$_0$ per layer, with the innermost layers possibly positioned inside the beam pipe. In addition to superior tracking and vertexing capabilities over a wide momentum range down to a few tens of MeV/$c$, the detector will provide particle identification via time-of-flight determination with about 20~ps resolution. In addition, electron and photon identification will be performed in a separate shower detector. The proposed detector is conceived for studies of pp, pA and AA collisions at luminosities a factor of 20 to 50 times higher than possible with the upgraded ALICE detector, enabling a rich physics program ranging from measurements with electromagnetic probes at ultra-low transverse momenta to precision physics in the charm and beauty sector.
△ Less
Submitted 2 May, 2019; v1 submitted 31 January, 2019;
originally announced February 2019.
-
Photoproduction in Ultra-Peripheral Relativistic Heavy Ion Collisions with STAR
Authors:
J. E. Seger
Abstract:
We present a summary of recent photoproduction results in ultra peripheral relativistic heavy ions collisions with STAR. These collisions have impact parameters larger then twice the nuclear radius; the nuclei do not physically collide, but interact via long-range electromagnetic fields. We observe exclusive $ρ^0$ production as well as $AuAu\to Au^*Au^* ρ^0$ with accompanying mutual nuclear exci…
▽ More
We present a summary of recent photoproduction results in ultra peripheral relativistic heavy ions collisions with STAR. These collisions have impact parameters larger then twice the nuclear radius; the nuclei do not physically collide, but interact via long-range electromagnetic fields. We observe exclusive $ρ^0$ production as well as $AuAu\to Au^*Au^* ρ^0$ with accompanying mutual nuclear excitation at $\sqrt{s_{NN}}=200$ GeV. We report the $ρ^0$ production cross section for both coherent and incoherent coupling accompanied by mutual nuclear excitation. We have studied the cross section as a function of $p_T$, $y_{ρ^0}$ and $M_{ππ}$ and compared it to theoretical models. In addition, we measured the $ρ^0$ helicity matrix elements. They are found to be consistent with s-channel helicity conservation. The ratio of coherent $ρ^0$ and direct $π^+π^-$ pair photoproduction has been measured and found to be consistent with earlier measurements. The 4-pion final state $AuAu \to π^+π^-π^+π^-$ state has also been observed.
△ Less
Submitted 20 December, 2007;
originally announced December 2007.
-
Fermion Pair Production From an Electric Field Varying in Two Dimensions
Authors:
J. E. Seger,
A. B. Balantekin
Abstract:
The Hamiltonian describing fermion pair production from an arbitrarily time-varying electric field in two dimensions is studied using a group-theoretic approach. We show that this Hamiltonian can be encompassed by two, commuting SU(2) algebras, and that the two-dimensional problem can therefore be reduced to two one-dimensional problems. We compare the group structure for the two-dimensional pro…
▽ More
The Hamiltonian describing fermion pair production from an arbitrarily time-varying electric field in two dimensions is studied using a group-theoretic approach. We show that this Hamiltonian can be encompassed by two, commuting SU(2) algebras, and that the two-dimensional problem can therefore be reduced to two one-dimensional problems. We compare the group structure for the two-dimensional problem with that previously derived for the one-dimensional problem, and verify that the Schwinger result is obtained under the appropriate conditions.
△ Less
Submitted 26 June, 1995;
originally announced June 1995.
