ZAPBench: A Benchmark for Whole-Brain Activity Prediction in Zebrafish
Authors:
Jan-Matthis Lueckmann,
Alexander Immer,
Alex Bo-Yuan Chen,
Peter H. Li,
Mariela D. Petkova,
Nirmala A. Iyer,
Luuk Willem Hesselink,
Aparna Dev,
Gudrun Ihrke,
Woohyun Park,
Alyson Petruncio,
Aubrey Weigel,
Wyatt Korff,
Florian Engert,
Jeff W. Lichtman,
Misha B. Ahrens,
Michał Januszewski,
Viren Jain
Abstract:
Data-driven benchmarks have led to significant progress in key scientific modeling domains including weather and structural biology. Here, we introduce the Zebrafish Activity Prediction Benchmark (ZAPBench) to measure progress on the problem of predicting cellular-resolution neural activity throughout an entire vertebrate brain. The benchmark is based on a novel dataset containing 4d light-sheet m…
▽ More
Data-driven benchmarks have led to significant progress in key scientific modeling domains including weather and structural biology. Here, we introduce the Zebrafish Activity Prediction Benchmark (ZAPBench) to measure progress on the problem of predicting cellular-resolution neural activity throughout an entire vertebrate brain. The benchmark is based on a novel dataset containing 4d light-sheet microscopy recordings of over 70,000 neurons in a larval zebrafish brain, along with motion stabilized and voxel-level cell segmentations of these data that facilitate development of a variety of forecasting methods. Initial results from a selection of time series and volumetric video modeling approaches achieve better performance than naive baseline methods, but also show room for further improvement. The specific brain used in the activity recording is also undergoing synaptic-level anatomical mapping, which will enable future integration of detailed structural information into forecasting methods.
△ Less
Submitted 4 March, 2025;
originally announced March 2025.
Forecasting Whole-Brain Neuronal Activity from Volumetric Video
Authors:
Alexander Immer,
Jan-Matthis Lueckmann,
Alex Bo-Yuan Chen,
Peter H. Li,
Mariela D. Petkova,
Nirmala A. Iyer,
Aparna Dev,
Gudrun Ihrke,
Woohyun Park,
Alyson Petruncio,
Aubrey Weigel,
Wyatt Korff,
Florian Engert,
Jeff W. Lichtman,
Misha B. Ahrens,
Viren Jain,
Michał Januszewski
Abstract:
Large-scale neuronal activity recordings with fluorescent calcium indicators are increasingly common, yielding high-resolution 2D or 3D videos. Traditional analysis pipelines reduce this data to 1D traces by segmenting regions of interest, leading to inevitable information loss. Inspired by the success of deep learning on minimally processed data in other domains, we investigate the potential of f…
▽ More
Large-scale neuronal activity recordings with fluorescent calcium indicators are increasingly common, yielding high-resolution 2D or 3D videos. Traditional analysis pipelines reduce this data to 1D traces by segmenting regions of interest, leading to inevitable information loss. Inspired by the success of deep learning on minimally processed data in other domains, we investigate the potential of forecasting neuronal activity directly from volumetric videos. To capture long-range dependencies in high-resolution volumetric whole-brain recordings, we design a model with large receptive fields, which allow it to integrate information from distant regions within the brain. We explore the effects of pre-training and perform extensive model selection, analyzing spatio-temporal trade-offs for generating accurate forecasts. Our model outperforms trace-based forecasting approaches on ZAPBench, a recently proposed benchmark on whole-brain activity prediction in zebrafish, demonstrating the advantages of preserving the spatial structure of neuronal activity.
△ Less
Submitted 27 February, 2025;
originally announced March 2025.
