-
3W Dataset 2.0.0: a realistic and public dataset with rare undesirable real events in oil wells
Authors:
Ricardo Emanuel Vaz Vargas,
Afrânio José de Melo Junior,
Celso José Munaro,
Cláudio Benevenuto de Campos Lima,
Eduardo Toledo de Lima Junior,
Felipe Muntzberg Barrocas,
Flávio Miguel Varejão,
Guilherme Fidelis Peixer,
Igor de Melo Nery Oliveira,
Jader Riso Barbosa Jr.,
Jaime Andrés Lozano Cadena,
Jean Carlos Dias de Araújo,
João Neuenschwander Escosteguy Carneiro,
Lucas Gouveia Omena Lopes,
Lucas Pereira de Gouveia,
Mateus de Araujo Fernandes,
Matheus Lima Scramignon,
Patrick Marques Ciarelli,
Rodrigo Castello Branco,
Rogério Leite Alves Pinto
Abstract:
In the oil industry, undesirable events in oil wells can cause economic losses, environmental accidents, and human casualties. Solutions based on Artificial Intelligence and Machine Learning for Early Detection of such events have proven valuable for diverse applications across industries. In 2019, recognizing the importance and the lack of public datasets related to undesirable events in oil well…
▽ More
In the oil industry, undesirable events in oil wells can cause economic losses, environmental accidents, and human casualties. Solutions based on Artificial Intelligence and Machine Learning for Early Detection of such events have proven valuable for diverse applications across industries. In 2019, recognizing the importance and the lack of public datasets related to undesirable events in oil wells, Petrobras developed and publicly released the first version of the 3W Dataset, which is essentially a set of Multivariate Time Series labeled by experts. Since then, the 3W Dataset has been developed collaboratively and has become a foundational reference for numerous works in the field. This data article describes the current publicly available version of the 3W Dataset, which contains structural modifications and additional labeled data. The detailed description provided encourages and supports the 3W community and new 3W users to improve previous published results and to develop new robust methodologies, digital products and services capable of detecting undesirable events in oil wells with enough anticipation to enable corrective or mitigating actions.
△ Less
Submitted 25 June, 2025;
originally announced July 2025.
-
Deep Active Learning based Experimental Design to Uncover Synergistic Genetic Interactions for Host Targeted Therapeutics
Authors:
Haonan Zhu,
Mary Silva,
Jose Cadena,
Braden Soper,
Michał Lisicki,
Braian Peetoom,
Sergio E. Baranzini,
Shivshankar Sundaram,
Priyadip Ray,
Jeff Drocco
Abstract:
Recent technological advances have introduced new high-throughput methods for studying host-virus interactions, but testing synergistic interactions between host gene pairs during infection remains relatively slow and labor intensive. Identification of multiple gene knockdowns that effectively inhibit viral replication requires a search over the combinatorial space of all possible target gene pair…
▽ More
Recent technological advances have introduced new high-throughput methods for studying host-virus interactions, but testing synergistic interactions between host gene pairs during infection remains relatively slow and labor intensive. Identification of multiple gene knockdowns that effectively inhibit viral replication requires a search over the combinatorial space of all possible target gene pairs and is infeasible via brute-force experiments. Although active learning methods for sequential experimental design have shown promise, existing approaches have generally been restricted to single-gene knockdowns or small-scale double knockdown datasets. In this study, we present an integrated Deep Active Learning (DeepAL) framework that incorporates information from a biological knowledge graph (SPOKE, the Scalable Precision Medicine Open Knowledge Engine) to efficiently search the configuration space of a large dataset of all pairwise knockdowns of 356 human genes in HIV infection. Through graph representation learning, the framework is able to generate task-specific representations of genes while also balancing the exploration-exploitation trade-off to pinpoint highly effective double-knockdown pairs. We additionally present an ensemble method for uncertainty quantification and an interpretation of the gene pairs selected by our algorithm via pathway analysis. To our knowledge, this is the first work to show promising results on double-gene knockdown experimental data of appreciable scale (356 by 356 matrix).
△ Less
Submitted 2 February, 2025;
originally announced February 2025.
-
Scientific Computing Algorithms to Learn Enhanced Scalable Surrogates for Mesh Physics
Authors:
Brian R. Bartoldson,
Yeping Hu,
Amar Saini,
Jose Cadena,
Yucheng Fu,
Jie Bao,
Zhijie Xu,
Brenda Ng,
Phan Nguyen
Abstract:
Data-driven modeling approaches can produce fast surrogates to study large-scale physics problems. Among them, graph neural networks (GNNs) that operate on mesh-based data are desirable because they possess inductive biases that promote physical faithfulness, but hardware limitations have precluded their application to large computational domains. We show that it is \textit{possible} to train a cl…
▽ More
Data-driven modeling approaches can produce fast surrogates to study large-scale physics problems. Among them, graph neural networks (GNNs) that operate on mesh-based data are desirable because they possess inductive biases that promote physical faithfulness, but hardware limitations have precluded their application to large computational domains. We show that it is \textit{possible} to train a class of GNN surrogates on 3D meshes. We scale MeshGraphNets (MGN), a subclass of GNNs for mesh-based physics modeling, via our domain decomposition approach to facilitate training that is mathematically equivalent to training on the whole domain under certain conditions. With this, we were able to train MGN on meshes with \textit{millions} of nodes to generate computational fluid dynamics (CFD) simulations. Furthermore, we show how to enhance MGN via higher-order numerical integration, which can reduce MGN's error and training time. We validated our methods on an accompanying dataset of 3D $\text{CO}_2$-capture CFD simulations on a 3.1M-node mesh. This work presents a practical path to scaling MGN for real-world applications.
△ Less
Submitted 1 April, 2023;
originally announced April 2023.
-
EMBERS at 4 years: Experiences operating an Open Source Indicators Forecasting System
Authors:
Sathappan Muthiah,
Patrick Butler,
Rupinder Paul Khandpur,
Parang Saraf,
Nathan Self,
Alla Rozovskaya,
Liang Zhao,
Jose Cadena,
Chang-Tien Lu,
Anil Vullikanti,
Achla Marathe,
Kristen Summers,
Graham Katz,
Andy Doyle,
Jaime Arredondo,
Dipak K. Gupta,
David Mares,
Naren Ramakrishnan
Abstract:
EMBERS is an anticipatory intelligence system forecasting population-level events in multiple countries of Latin America. A deployed system from 2012, EMBERS has been generating alerts 24x7 by ingesting a broad range of data sources including news, blogs, tweets, machine coded events, currency rates, and food prices. In this paper, we describe our experiences operating EMBERS continuously for near…
▽ More
EMBERS is an anticipatory intelligence system forecasting population-level events in multiple countries of Latin America. A deployed system from 2012, EMBERS has been generating alerts 24x7 by ingesting a broad range of data sources including news, blogs, tweets, machine coded events, currency rates, and food prices. In this paper, we describe our experiences operating EMBERS continuously for nearly 4 years, with specific attention to the discoveries it has enabled, correct as well as missed forecasts, and lessons learnt from participating in a forecasting tournament including our perspectives on the limits of forecasting and ethical considerations.
△ Less
Submitted 31 March, 2016;
originally announced April 2016.
-
'Beating the news' with EMBERS: Forecasting Civil Unrest using Open Source Indicators
Authors:
Naren Ramakrishnan,
Patrick Butler,
Sathappan Muthiah,
Nathan Self,
Rupinder Khandpur,
Parang Saraf,
Wei Wang,
Jose Cadena,
Anil Vullikanti,
Gizem Korkmaz,
Chris Kuhlman,
Achla Marathe,
Liang Zhao,
Ting Hua,
Feng Chen,
Chang-Tien Lu,
Bert Huang,
Aravind Srinivasan,
Khoa Trinh,
Lise Getoor,
Graham Katz,
Andy Doyle,
Chris Ackermann,
Ilya Zavorin,
Jim Ford
, et al. (5 additional authors not shown)
Abstract:
We describe the design, implementation, and evaluation of EMBERS, an automated, 24x7 continuous system for forecasting civil unrest across 10 countries of Latin America using open source indicators such as tweets, news sources, blogs, economic indicators, and other data sources. Unlike retrospective studies, EMBERS has been making forecasts into the future since Nov 2012 which have been (and conti…
▽ More
We describe the design, implementation, and evaluation of EMBERS, an automated, 24x7 continuous system for forecasting civil unrest across 10 countries of Latin America using open source indicators such as tweets, news sources, blogs, economic indicators, and other data sources. Unlike retrospective studies, EMBERS has been making forecasts into the future since Nov 2012 which have been (and continue to be) evaluated by an independent T&E team (MITRE). Of note, EMBERS has successfully forecast the uptick and downtick of incidents during the June 2013 protests in Brazil. We outline the system architecture of EMBERS, individual models that leverage specific data sources, and a fusion and suppression engine that supports trading off specific evaluation criteria. EMBERS also provides an audit trail interface that enables the investigation of why specific predictions were made along with the data utilized for forecasting. Through numerous evaluations, we demonstrate the superiority of EMBERS over baserate methods and its capability to forecast significant societal happenings.
△ Less
Submitted 27 February, 2014; v1 submitted 27 February, 2014;
originally announced February 2014.