SciOps: Achieving Productivity and Reliability in Data-Intensive Research
Authors:
Erik C. Johnson,
Thinh T. Nguyen,
Benjamin K. Dichter,
Frank Zappulla,
Montgomery Kosma,
Kabilar Gunalan,
Yaroslav O. Halchenko,
Shay Q. Neufeld,
Kristen Ratan,
Nicholas J. Edwards,
Susanne Ressl,
Sarah R. Heilbronner,
Michael Schirner,
Petra Ritter,
Brock Wester,
Satrajit Ghosh,
Maryann E. Martone,
Franco Pestilli,
Dimitri Yatsenko
Abstract:
Scientists are increasingly leveraging advances in instruments, automation, and collaborative tools to scale up their experiments and research goals, leading to new bursts of discovery. Various scientific disciplines, including neuroscience, have adopted key technologies to enhance collaboration, reproducibility, and automation. Drawing inspiration from advancements in the software industry, we pr…
▽ More
Scientists are increasingly leveraging advances in instruments, automation, and collaborative tools to scale up their experiments and research goals, leading to new bursts of discovery. Various scientific disciplines, including neuroscience, have adopted key technologies to enhance collaboration, reproducibility, and automation. Drawing inspiration from advancements in the software industry, we present a roadmap to enhance the reliability and scalability of scientific operations for diverse research teams tackling large and complex projects. We introduce a five-level Capability Maturity Model describing the principles of rigorous scientific operations in projects ranging from small-scale exploratory studies to large-scale, multi-disciplinary research endeavors. Achieving higher levels of operational maturity necessitates the adoption of new, technology-enabled methodologies, which we refer to as SciOps. This concept is derived from the DevOps methodologies that have revolutionized the software industry. SciOps involves digital research environments that seamlessly integrate computational, automation, and AI-driven efforts throughout the research cycle-from experimental design and data collection to analysis and dissemination, ultimately leading to closed-loop discovery. This maturity model offers a framework for assessing and improving operational practices in multidisciplinary research teams, guiding them towards greater efficiency and effectiveness in scientific inquiry.
△ Less
Submitted 6 November, 2024; v1 submitted 29 December, 2023;
originally announced January 2024.
Efficient and accurate extraction of in vivo calcium signals from microendoscopic video data
Authors:
Pengcheng Zhou,
Shanna L. Resendez,
Jose Rodriguez-Romaguera,
Jessica C. Jimenez,
Shay Q. Neufeld,
Garret D. Stuber,
Rene Hen,
Mazen A. Kheirbek,
Bernardo L. Sabatini,
Robert E. Kass,
Liam Paninski
Abstract:
In vivo calcium imaging through microscopes has enabled deep brain imaging of previously inaccessible neuronal populations within the brains of freely moving subjects. However, microendoscopic data suffer from high levels of background fluorescence as well as an increased potential for overlapping neuronal signals. Previous methods fail in identifying neurons and demixing their temporal activity b…
▽ More
In vivo calcium imaging through microscopes has enabled deep brain imaging of previously inaccessible neuronal populations within the brains of freely moving subjects. However, microendoscopic data suffer from high levels of background fluorescence as well as an increased potential for overlapping neuronal signals. Previous methods fail in identifying neurons and demixing their temporal activity because the cellular signals are often submerged in the large fluctuating background. Here we develop an efficient method to extract cellular signals with minimal influence from the background. We model the background with two realistic components: (1) one models the constant baseline and slow trends of each pixel, and (2) the other models the fast fluctuations from out-of-focus signals and is therefore constrained to have low spatial-frequency structure. This decomposition avoids cellular signals being absorbed into the background term. After subtracting the background approximated with this model, we use Constrained Nonnegative Matrix Factorization (CNMF, Pnevmatikakis et al. (2016)) to better demix neural signals and get their denoised and deconvolved temporal activity. We validate our method on simulated and experimental data, where it shows fast, reliable, and high quality signal extraction under a wide variety of imaging parameters.
△ Less
Submitted 25 May, 2017; v1 submitted 23 May, 2016;
originally announced May 2016.
