Skip to main content

Showing 1–16 of 16 results for author: Brunschwiler, T

.
  1. arXiv:2504.16851  [pdf, other

    cs.CV

    Hyperspectral Vision Transformers for Greenhouse Gas Estimations from Space

    Authors: Ruben Gonzalez Avilés, Linus Scheibenreif, Nassim Ait Ali Braham, Benedikt Blumenstiel, Thomas Brunschwiler, Ranjini Guruprasad, Damian Borth, Conrad Albrecht, Paolo Fraccaro, Devyani Lambhate, Johannes Jakubik

    Abstract: Hyperspectral imaging provides detailed spectral information and holds significant potential for monitoring of greenhouse gases (GHGs). However, its application is constrained by limited spatial coverage and infrequent revisit times. In contrast, multispectral imaging offers broader spatial and temporal coverage but often lacks the spectral detail that can enhance GHG detection. To address these c… ▽ More

    Submitted 23 April, 2025; originally announced April 2025.

  2. arXiv:2504.11172  [pdf, other

    cs.CV

    TerraMesh: A Planetary Mosaic of Multimodal Earth Observation Data

    Authors: Benedikt Blumenstiel, Paolo Fraccaro, Valerio Marsocci, Johannes Jakubik, Stefano Maurogiovanni, Mikolaj Czerkawski, Rocco Sedona, Gabriele Cavallaro, Thomas Brunschwiler, Juan Bernabe-Moreno, Nicolas Longépé

    Abstract: Large-scale foundation models in Earth Observation can learn versatile, label-efficient representations by leveraging massive amounts of unlabeled data. However, existing public datasets are often limited in scale, geographic coverage, or sensor variety. We introduce TerraMesh, a new globally diverse, multimodal dataset combining optical, synthetic aperture radar, elevation, and land-cover modalit… ▽ More

    Submitted 15 April, 2025; originally announced April 2025.

  3. arXiv:2504.11171  [pdf, other

    cs.CV cs.AI

    TerraMind: Large-Scale Generative Multimodality for Earth Observation

    Authors: Johannes Jakubik, Felix Yang, Benedikt Blumenstiel, Erik Scheurer, Rocco Sedona, Stefano Maurogiovanni, Jente Bosmans, Nikolaos Dionelis, Valerio Marsocci, Niklas Kopp, Rahul Ramachandran, Paolo Fraccaro, Thomas Brunschwiler, Gabriele Cavallaro, Juan Bernabe-Moreno, Nicolas Longépé

    Abstract: We present TerraMind, the first any-to-any generative, multimodal foundation model for Earth observation (EO). Unlike other multimodal models, TerraMind is pretrained on dual-scale representations combining both token-level and pixel-level data across modalities. On a token level, TerraMind encodes high-level contextual information to learn cross-modal relationships, while on a pixel level, TerraM… ▽ More

    Submitted 15 April, 2025; originally announced April 2025.

  4. arXiv:2503.15969  [pdf, other

    cs.CV cs.AI

    Beyond the Visible: Multispectral Vision-Language Learning for Earth Observation

    Authors: Clive Tinashe Marimo, Benedikt Blumenstiel, Maximilian Nitsche, Johannes Jakubik, Thomas Brunschwiler

    Abstract: Vision-language models for Earth observation (EO) typically rely on the visual spectrum of data as the only model input, thus failing to leverage the rich spectral information available in the multispectral channels recorded by satellites. Therefore, in this paper, we introduce Llama3-MS-CLIP, the first vision-language model pre-trained with contrastive learning on a large-scale multispectral data… ▽ More

    Submitted 20 March, 2025; originally announced March 2025.

  5. arXiv:2503.01505  [pdf, other

    eess.SP cs.AI cs.CV cs.LG physics.geo-ph

    Lossy Neural Compression for Geospatial Analytics: A Review

    Authors: Carlos Gomes, Isabelle Wittmann, Damien Robert, Johannes Jakubik, Tim Reichelt, Michele Martone, Stefano Maurogiovanni, Rikard Vinge, Jonas Hurst, Erik Scheurer, Rocco Sedona, Thomas Brunschwiler, Stefan Kesselheim, Matej Batic, Philip Stier, Jan Dirk Wegner, Gabriele Cavallaro, Edzer Pebesma, Michael Marszalek, Miguel A Belenguer-Plomer, Kennedy Adriko, Paolo Fraccaro, Romeo Kienzler, Rania Briq, Sabrina Benassou , et al. (2 additional authors not shown)

    Abstract: Over the past decades, there has been an explosion in the amount of available Earth Observation (EO) data. The unprecedented coverage of the Earth's surface and atmosphere by satellite imagery has resulted in large volumes of data that must be transmitted to ground stations, stored in data centers, and distributed to end users. Modern Earth System Models (ESMs) face similar challenges, operating a… ▽ More

    Submitted 3 March, 2025; originally announced March 2025.

    Comments: self-consistent review paper

  6. arXiv:2502.19451  [pdf, other

    eess.IV cs.AI

    Multispectral to Hyperspectral using Pretrained Foundational model

    Authors: Ruben Gonzalez, Conrad M Albrecht, Nassim Ait Ali Braham, Devyani Lambhate, Joao Lucas de Sousa Almeida, Paolo Fraccaro, Benedikt Blumenstiel, Thomas Brunschwiler, Ranjini Bangalore

    Abstract: Hyperspectral imaging provides detailed spectral information, offering significant potential for monitoring greenhouse gases like CH4 and NO2. However, its application is constrained by limited spatial coverage and infrequent revisit times. In contrast, multispectral imaging delivers broader spatial and temporal coverage but lacks the spectral granularity required for precise GHG detection. To add… ▽ More

    Submitted 26 February, 2025; originally announced February 2025.

  7. arXiv:2411.08652  [pdf, other

    cs.LG

    Accelerating Quasi-Static Time Series Simulations with Foundation Models

    Authors: Alban Puech, François Mirallès, Jonas Weiss, Vincent Mai, Alexandre Blondin Massé, Martin de Montigny, Thomas Brunschwiler, Hendrik F. Hamann

    Abstract: Quasi-static time series (QSTS) simulations have great potential for evaluating the grid's ability to accommodate the large-scale integration of distributed energy resources. However, as grids expand and operate closer to their limits, iterative power flow solvers, central to QSTS simulations, become computationally prohibitive and face increasing convergence issues. Neural power flow solvers prov… ▽ More

    Submitted 13 November, 2024; originally announced November 2024.

    Comments: Equal contributors: A.P. and F.M.; Lead contact: A.P

  8. arXiv:2409.02148  [pdf, other

    eess.SY cs.AI cs.LG math.OC

    Optimal Power Grid Operations with Foundation Models

    Authors: Alban Puech, Jonas Weiss, Thomas Brunschwiler, Hendrik F. Hamann

    Abstract: The energy transition, crucial for tackling the climate crisis, demands integrating numerous distributed, renewable energy sources into existing grids. Along with climate change and consumer behavioral changes, this leads to changes and variability in generation and load patterns, introducing significant complexity and uncertainty into grid planning and operations. While the industry has already s… ▽ More

    Submitted 3 September, 2024; originally announced September 2024.

  9. arXiv:2407.09434  [pdf, other

    cs.LG cs.AI cs.CE eess.SY

    Foundation Models for the Electric Power Grid

    Authors: Hendrik F. Hamann, Thomas Brunschwiler, Blazhe Gjorgiev, Leonardo S. A. Martins, Alban Puech, Anna Varbella, Jonas Weiss, Juan Bernabe-Moreno, Alexandre Blondin Massé, Seong Choi, Ian Foster, Bri-Mathias Hodge, Rishabh Jain, Kibaek Kim, Vincent Mai, François Mirallès, Martin De Montigny, Octavio Ramos-Leaños, Hussein Suprême, Le Xie, El-Nasser S. Youssef, Arnaud Zinflou, Alexander J. Belyi, Ricardo J. Bessa, Bishnu Prasad Bhattarai , et al. (2 additional authors not shown)

    Abstract: Foundation models (FMs) currently dominate news headlines. They employ advanced deep learning architectures to extract structural information autonomously from vast datasets through self-supervision. The resulting rich representations of complex systems and dynamics can be applied to many downstream applications. Therefore, FMs can find uses in electric power grids, challenged by the energy transi… ▽ More

    Submitted 12 November, 2024; v1 submitted 12 July, 2024; originally announced July 2024.

    Comments: Major equal contributors: H.F.H., T.B., B.G., L.S.A.M., A.P., A.V., J.W.; Significant equal contributors: J.B., A.B.M., S.C., I.F., B.H., R.J., K.K., V.M., F.M., M.D.M., O.R., H.S., L.X., E.S.Y., A.Z.; Other equal contributors: A.J.B., R.J.B., B.P.B., J.S., S.S; Lead contact: H.F.H

  10. arXiv:2403.17886  [pdf, other

    cs.LG

    Neural Embedding Compression For Efficient Multi-Task Earth Observation Modelling

    Authors: Carlos Gomes, Thomas Brunschwiler

    Abstract: As repositories of large scale data in earth observation (EO) have grown, so have transfer and storage costs for model training and inference, expending significant resources. We introduce Neural Embedding Compression (NEC), based on the transfer of compressed embeddings to data consumers instead of raw data. We adapt foundation models (FM) through learned neural compression to generate multi-task… ▽ More

    Submitted 9 July, 2024; v1 submitted 26 March, 2024; originally announced March 2024.

    Comments: Published at IGARSS 2024

  11. arXiv:2403.02059  [pdf, other

    cs.CV

    Multi-Spectral Remote Sensing Image Retrieval Using Geospatial Foundation Models

    Authors: Benedikt Blumenstiel, Viktoria Moor, Romeo Kienzler, Thomas Brunschwiler

    Abstract: Image retrieval enables an efficient search through vast amounts of satellite imagery and returns similar images to a query. Deep learning models can identify images across various semantic concepts without the need for annotations. This work proposes to use Geospatial Foundation Models, like Prithvi, for remote sensing image retrieval with multiple benefits: i) the models encode multi-spectral sa… ▽ More

    Submitted 22 May, 2024; v1 submitted 4 March, 2024; originally announced March 2024.

    Comments: Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS)

  12. arXiv:2309.01066  [pdf, other

    cs.CV cs.AI cs.CY eess.IV physics.geo-ph

    AB2CD: AI for Building Climate Damage Classification and Detection

    Authors: Maximilian Nitsche, S. Karthik Mukkavilli, Niklas Kühl, Thomas Brunschwiler

    Abstract: We explore the implementation of deep learning techniques for precise building damage assessment in the context of natural hazards, utilizing remote sensing data. The xBD dataset, comprising diverse disaster events from across the globe, serves as the primary focus, facilitating the evaluation of deep learning models. We tackle the challenges of generalization to novel disasters and regions while… ▽ More

    Submitted 2 September, 2023; originally announced September 2023.

    Comments: 9 pages, 4 figures

    MSC Class: 68T07 (Primary); 68T45; 86A08; 74A45 (Secondary) ACM Class: I.2.10; I.4.8; I.4.6; I.5.4; I.2.6

  13. arXiv:2301.09318  [pdf, other

    cs.CV cs.LG

    Toward Foundation Models for Earth Monitoring: Generalizable Deep Learning Models for Natural Hazard Segmentation

    Authors: Johannes Jakubik, Michal Muszynski, Michael Vössing, Niklas Kühl, Thomas Brunschwiler

    Abstract: Climate change results in an increased probability of extreme weather events that put societies and businesses at risk on a global scale. Therefore, near real-time mapping of natural hazards is an emerging priority for the support of natural disaster relief, risk management, and informing governmental policy decisions. Recent methods to achieve near real-time mapping increasingly leverage deep lea… ▽ More

    Submitted 1 June, 2023; v1 submitted 23 January, 2023; originally announced January 2023.

    Comments: Accepted at IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2023)

  14. arXiv:1911.04559  [pdf, other

    cs.LG cs.DC stat.ML

    Privacy is What We Care About: Experimental Investigation of Federated Learning on Edge Devices

    Authors: Anirban Das, Thomas Brunschwiler

    Abstract: Federated Learning enables training of a general model through edge devices without sending raw data to the cloud. Hence, this approach is attractive for digital health applications, where data is sourced through edge devices and users care about privacy. Here, we report on the feasibility to train deep neural networks on the Raspberry Pi4s as edge devices. A CNN, a LSTM and a MLP were successfull… ▽ More

    Submitted 11 November, 2019; originally announced November 2019.

    Comments: Accepted in ACM AIChallengeIoT 2019, New York, USA

  15. arXiv:0801.1046  [pdf

    physics.gen-ph

    High Performance Thermal Interface Technology Overview

    Authors: R. Linderman, T. Brunschwiler, B. Smith, B. Michel

    Abstract: An overview on recent developments in thermal interfaces is given with a focus on a novel thermal interface technology that allows the formation of 2-3 times thinner bondlines with strongly improved thermal properties at lower assembly pressures. This is achieved using nested hierarchical surface channels to control the particle stacking with highly particle-filled materials. Reliability testing… ▽ More

    Submitted 7 January, 2008; originally announced January 2008.

    Comments: Submitted on behalf of TIMA Editions (http://irevues.inist.fr/tima-editions)

    Journal ref: Dans 13th International Worshop on THERMal INvestigations of ICs and Systems - THERMINIC 2007, Budapest : Hongrie (2007)

  16. arXiv:0801.1009  [pdf

    physics.gen-ph

    Utility of transient testing to characterize thermal interface materials

    Authors: B. Smith, T. Brunschwiler, B. Michel

    Abstract: This paper analyzes a transient method for the characterization of low-resistance thermal interfaces of microelectronic packages. The transient method can yield additional information about the package not available with traditional static methods at the cost of greater numerical complexity, hardware requirements, and sensitivity to noise. While the method is established for package-level therma… ▽ More

    Submitted 7 January, 2008; originally announced January 2008.

    Comments: Submitted on behalf of TIMA Editions (http://irevues.inist.fr/tima-editions)

    Journal ref: Dans 13th International Worshop on THERMal INvestigations of ICs and Systems - THERMINIC 2007, Budapest : Hongrie (2007)