TerraTorch: The Geospatial Foundation Models Toolkit
Authors:
Carlos Gomes,
Benedikt Blumenstiel,
Joao Lucas de Sousa Almeida,
Pedro Henrique de Oliveira,
Paolo Fraccaro,
Francesc Marti Escofet,
Daniela Szwarcman,
Naomi Simumba,
Romeo Kienzler,
Bianca Zadrozny
Abstract:
TerraTorch is a fine-tuning and benchmarking toolkit for Geospatial Foundation Models built on PyTorch Lightning and tailored for satellite, weather, and climate data. It integrates domain-specific data modules, pre-defined tasks, and a modular model factory that pairs any backbone with diverse decoder heads. These components allow researchers and practitioners to fine-tune supported models in a n…
▽ More
TerraTorch is a fine-tuning and benchmarking toolkit for Geospatial Foundation Models built on PyTorch Lightning and tailored for satellite, weather, and climate data. It integrates domain-specific data modules, pre-defined tasks, and a modular model factory that pairs any backbone with diverse decoder heads. These components allow researchers and practitioners to fine-tune supported models in a no-code fashion by simply editing a training configuration. By consolidating best practices for model development and incorporating the automated hyperparameter optimization extension Iterate, TerraTorch reduces the expertise and time required to fine-tune or benchmark models on new Earth Observation use cases. Furthermore, TerraTorch directly integrates with GEO-Bench, allowing for systematic and reproducible benchmarking of Geospatial Foundation Models. TerraTorch is open sourced under Apache 2.0, available at https://github.com/IBM/terratorch, and can be installed via pip install terratorch.
△ Less
Submitted 26 March, 2025;
originally announced March 2025.
Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applications
Authors:
Daniela Szwarcman,
Sujit Roy,
Paolo Fraccaro,
Þorsteinn Elí Gíslason,
Benedikt Blumenstiel,
Rinki Ghosal,
Pedro Henrique de Oliveira,
Joao Lucas de Sousa Almeida,
Rocco Sedona,
Yanghui Kang,
Srija Chakraborty,
Sizhe Wang,
Carlos Gomes,
Ankur Kumar,
Myscon Truong,
Denys Godwin,
Hyunho Lee,
Chia-Yu Hsu,
Ata Akbari Asanjan,
Besart Mujeci,
Disha Shidham,
Trevor Keenan,
Paulo Arevalo,
Wenwen Li,
Hamed Alemohammad
, et al. (10 additional authors not shown)
Abstract:
This technical report presents Prithvi-EO-2.0, a new geospatial foundation model that offers significant improvements over its predecessor, Prithvi-EO-1.0. Trained on 4.2M global time series samples from NASA's Harmonized Landsat and Sentinel-2 data archive at 30m resolution, the new 300M and 600M parameter models incorporate temporal and location embeddings for enhanced performance across various…
▽ More
This technical report presents Prithvi-EO-2.0, a new geospatial foundation model that offers significant improvements over its predecessor, Prithvi-EO-1.0. Trained on 4.2M global time series samples from NASA's Harmonized Landsat and Sentinel-2 data archive at 30m resolution, the new 300M and 600M parameter models incorporate temporal and location embeddings for enhanced performance across various geospatial tasks. Through extensive benchmarking with GEO-Bench, the 600M version outperforms the previous Prithvi-EO model by 8\% across a range of tasks. It also outperforms six other geospatial foundation models when benchmarked on remote sensing tasks from different domains and resolutions (i.e. from 0.1m to 15m). The results demonstrate the versatility of the model in both classical earth observation and high-resolution applications. Early involvement of end-users and subject matter experts (SMEs) are among the key factors that contributed to the project's success. In particular, SME involvement allowed for constant feedback on model and dataset design, as well as successful customization for diverse SME-led applications in disaster response, land use and crop mapping, and ecosystem dynamics monitoring. Prithvi-EO-2.0 is available on Hugging Face and IBM terratorch, with additional resources on GitHub. The project exemplifies the Trusted Open Science approach embraced by all involved organizations.
△ Less
Submitted 3 February, 2025; v1 submitted 3 December, 2024;
originally announced December 2024.
