Showing 1–50 of 75 results for author: Kopp, M

Robust Magnetic Polaron Percolation in the Antiferromagnetic CMR System EuCd$_2$P$_2$

Authors: Marvin Kopp, Charu Garg, Sarah Krebber, Kristin Kliemt, Cornelius Krellner, Sudhaman Balguri, Mira Mahendru, Fazel Tafti, Theodore L. Breeze, Nathan P. Bentley, Francis L. Pratt, Thomas J. Hicken, Hubertus Luetkens, Jonas A. Krieger, Stephen J. Blundell, Tom Lancaster, M. Victoria Ale Crivillero, Steffen Wirth, Jens Müller

Abstract: Antiferromagnetic EuCd$_2$P$_2$ has attracted considerable attention due to its unconventional (magneto)transport properties. At a temperature $T_{\rm peak}$ significantly above the magnetic ordering temperature $T_\textrm{N} = 11\,$K a large peak in resistivity is observed which gets strongly suppressed in magnetic field, resulting in a colossal magnetoresistance (CMR), for which magnetic fluctua… ▽ More Antiferromagnetic EuCd$_2$P$_2$ has attracted considerable attention due to its unconventional (magneto)transport properties. At a temperature $T_{\rm peak}$ significantly above the magnetic ordering temperature $T_\textrm{N} = 11\,$K a large peak in resistivity is observed which gets strongly suppressed in magnetic field, resulting in a colossal magnetoresistance (CMR), for which magnetic fluctuations and the formation of ferromagnetic clusters have been proposed as underlying mechanisms. Employing a selection of sensitive probes including fluctuation spectroscopy and third-harmonic resistance, Hall effect, AC susceptibility and $μ$SR measurements, allows for a direct comparison of electronic and magnetic properties on multiple time scales. We find compelling evidence for the formation and percolation of magnetic polarons, which explains the CMR of the system. Large peaks in the weakly-nonlinear transport and the resistance noise power spectral density at zero magnetic field signify an inhomogeneous, percolating electronic system below $T^\ast \approx 2\,T_\textrm{N}$ with a percolation threshold at $T_{\rm peak}$. In magnetic fields, the onset of large negative MR in the paramagnetic regime occurs at a universal critical magnetization similar to ferromagnetic CMR materials. The size of the magnetic polarons at the percolation threshold is estimated to $\sim 1 - 2\,$nm. The mechanism of magntic cluster formation and percolation in EuCd$_2$P$_2$ appears to be rather robust despite large variations in carrier concentration and likely is relevant for other Eu-based antiferromagnetic CMR systems. △ Less

Submitted 31 March, 2025; originally announced March 2025.

Markerless Tracking-Based Registration for Medical Image Motion Correction

Authors: Luisa Neubig, Deirdre Larsen, Takeshi Ikuma, Markus Kopp, Melda Kunduk, Andreas M. Kist

Abstract: Our study focuses on isolating swallowing dynamics from interfering patient motion in videofluoroscopy, an X-ray technique that records patients swallowing a radiopaque bolus. These recordings capture multiple motion sources, including head movement, anatomical displacements, and bolus transit. To enable precise analysis of swallowing physiology, we aim to eliminate distracting motion, particularl… ▽ More Our study focuses on isolating swallowing dynamics from interfering patient motion in videofluoroscopy, an X-ray technique that records patients swallowing a radiopaque bolus. These recordings capture multiple motion sources, including head movement, anatomical displacements, and bolus transit. To enable precise analysis of swallowing physiology, we aim to eliminate distracting motion, particularly head movement, while preserving essential swallowing-related dynamics. Optical flow methods fail due to artifacts like flickering and instability, making them unreliable for distinguishing different motion groups. We evaluated markerless tracking approaches (CoTracker, PIPs++, TAP-Net) and quantified tracking accuracy in key medical regions of interest. Our findings show that even sparse tracking points generate morphing displacement fields that outperform leading registration methods such as ANTs, LDDMM, and VoxelMorph. To compare all approaches, we assessed performance using MSE and SSIM metrics post-registration. We introduce a novel motion correction pipeline that effectively removes disruptive motion while preserving swallowing dynamics and surpassing competitive registration techniques. △ Less

Submitted 21 March, 2025; v1 submitted 13 March, 2025; originally announced March 2025.

Comments: Under review

Magnetic frustration and weak Mn magnetic ordering in EuMn$_2$P$_2$

Authors: Sarah Krebber, Jörg Sichelschmidt, Pierre Chailloleau, Asmaa El Mard, Marvin Kopp, Michael Baenitz, Kurt Kummer, Denis V. Vyalikh, Jens Müller, Cornelius Krellner, Kristin Kliemt

Abstract: We report on the electron spin resonance (ESR), heat capacity, magnetization, nuclear magnetic resonance (NMR), magnetic circular and linear dichroism (XMCD, XMLD), as well as the electrical resistivity of EuMn$_{2}$P$_{2}$ single crystals. Antiferromagnetic order of Eu was observed in several quantities at $T^{\rm Eu}_{\rm N}\,=\,18\,\rm K$. The temperature dependencies of ESR linewidth and reson… ▽ More We report on the electron spin resonance (ESR), heat capacity, magnetization, nuclear magnetic resonance (NMR), magnetic circular and linear dichroism (XMCD, XMLD), as well as the electrical resistivity of EuMn$_{2}$P$_{2}$ single crystals. Antiferromagnetic order of Eu was observed in several quantities at $T^{\rm Eu}_{\rm N}\,=\,18\,\rm K$. The temperature dependencies of ESR linewidth and resonance shift show, when approaching the Eu-ordered state, a divergence towards $T^{\rm Eu}_{\rm N}$, indicating the growing importance of magnetic correlations and the build-up of internal magnetic fields. An additional temperature scale of $\approx 47\,\rm K$ has considerable impact on linewidth, resonance field and intensity. This points to the presence of weak Mn-based ordering. The observed ESR line is interpreted as an Eu$^{2+}$ resonance, which probes the weak magnetic background of the Mn subsystem. Such picture is suggested by the lineshape which keeps to be Lorentzian across the $47\,\rm K$ scale and by the ESR intensity which can be described by the same Curie-Weiss temperature above and below $47\,\rm K$. In the same temperature range anomalies were observed at $48.5\,\rm K$ and $51\,\rm K$ in the heat capacity data as well as a pronounced broadening of the NMR signal of the EuMn$_{2}$P$_{2}$ samples. In XMCD and XMLD measurements, this weak magnetic order could not be detected in the same temperature range which might be due to the small magnetic moment, with a potential $c$-component or frustration. △ Less

Submitted 2 January, 2025; originally announced January 2025.

ChangeMinds: Multi-task Framework for Detecting and Describing Changes in Remote Sensing

Authors: Yuduo Wang, Weikang Yu, Michael Kopp, Pedram Ghamisi

Abstract: Recent advancements in Remote Sensing (RS) for Change Detection (CD) and Change Captioning (CC) have seen substantial success by adopting deep learning techniques. Despite these advances, existing methods often handle CD and CC tasks independently, leading to inefficiencies from the absence of synergistic processing. In this paper, we present ChangeMinds, a novel unified multi-task framework that… ▽ More Recent advancements in Remote Sensing (RS) for Change Detection (CD) and Change Captioning (CC) have seen substantial success by adopting deep learning techniques. Despite these advances, existing methods often handle CD and CC tasks independently, leading to inefficiencies from the absence of synergistic processing. In this paper, we present ChangeMinds, a novel unified multi-task framework that concurrently optimizes CD and CC processes within a single, end-to-end model. We propose the change-aware long short-term memory module (ChangeLSTM) to effectively capture complex spatiotemporal dynamics from extracted bi-temporal deep features, enabling the generation of universal change-aware representations that effectively serve both CC and CD tasks. Furthermore, we introduce a multi-task predictor with a cross-attention mechanism that enhances the interaction between image and text features, promoting efficient simultaneous learning and processing for both tasks. Extensive evaluations on the LEVIR-MCI dataset, alongside other standard benchmarks, show that ChangeMinds surpasses existing methods in multi-task learning settings and markedly improves performance in individual CD and CC tasks. Codes and pre-trained models will be available online. △ Less

Submitted 15 October, 2024; v1 submitted 13 October, 2024; originally announced October 2024.

Command-line Obfuscation Detection using Small Language Models

Authors: Vojtech Outrata, Michael Adam Polak, Martin Kopp

Abstract: To avoid detection, adversaries often use command-line obfuscation. There are numerous techniques of the command-line obfuscation, all designed to alter the command-line syntax without affecting its original functionality. This variability forces most security solutions to create an exhaustive enumeration of signatures for even a single pattern. In contrast to using signatures, we have implemented… ▽ More To avoid detection, adversaries often use command-line obfuscation. There are numerous techniques of the command-line obfuscation, all designed to alter the command-line syntax without affecting its original functionality. This variability forces most security solutions to create an exhaustive enumeration of signatures for even a single pattern. In contrast to using signatures, we have implemented a scalable NLP-based detection method that leverages a custom-trained, small transformer language model that can be applied to any source of execution logs. The evaluation on top of real-world telemetry demonstrates that our approach yields high-precision detections even on high-volume telemetry from a diverse set of environments spanning from universities and businesses to healthcare or finance. The practical value is demonstrated in a case study of real-world samples detected by our model. We show the model's superiority to signatures on established malware known to employ obfuscation and showcase previously unseen obfuscated samples detected by our model. △ Less

Submitted 5 August, 2024; originally announced August 2024.

Multilingual Power and Ideology Identification in the Parliament: a Reference Dataset and Simple Baselines

Authors: Çağrı Çöltekin, Matyáš Kopp, Katja Meden, Vaidas Morkevicius, Nikola Ljubešić, Tomaž Erjavec

Abstract: We introduce a dataset on political orientation and power position identification. The dataset is derived from ParlaMint, a set of comparable corpora of transcribed parliamentary speeches from 29 national and regional parliaments. We introduce the dataset, provide the reasoning behind some of the choices during its creation, present statistics on the dataset, and, using a simple classifier, some b… ▽ More We introduce a dataset on political orientation and power position identification. The dataset is derived from ParlaMint, a set of comparable corpora of transcribed parliamentary speeches from 29 national and regional parliaments. We introduce the dataset, provide the reasoning behind some of the choices during its creation, present statistics on the dataset, and, using a simple classifier, some baseline results on predicting political orientation on the left-to-right axis, and on power position identification, i.e., distinguishing between the speeches delivered by governing coalition party members from those of opposition party members. △ Less

Submitted 12 May, 2024; originally announced May 2024.

xLSTM: Extended Long Short-Term Memory

Authors: Maximilian Beck, Korbinian Pöppel, Markus Spanring, Andreas Auer, Oleksandra Prudnikova, Michael Kopp, Günter Klambauer, Johannes Brandstetter, Sepp Hochreiter

Abstract: In the 1990s, the constant error carousel and gating were introduced as the central ideas of the Long Short-Term Memory (LSTM). Since then, LSTMs have stood the test of time and contributed to numerous deep learning success stories, in particular they constituted the first Large Language Models (LLMs). However, the advent of the Transformer technology with parallelizable self-attention at its core… ▽ More In the 1990s, the constant error carousel and gating were introduced as the central ideas of the Long Short-Term Memory (LSTM). Since then, LSTMs have stood the test of time and contributed to numerous deep learning success stories, in particular they constituted the first Large Language Models (LLMs). However, the advent of the Transformer technology with parallelizable self-attention at its core marked the dawn of a new era, outpacing LSTMs at scale. We now raise a simple question: How far do we get in language modeling when scaling LSTMs to billions of parameters, leveraging the latest techniques from modern LLMs, but mitigating known limitations of LSTMs? Firstly, we introduce exponential gating with appropriate normalization and stabilization techniques. Secondly, we modify the LSTM memory structure, obtaining: (i) sLSTM with a scalar memory, a scalar update, and new memory mixing, (ii) mLSTM that is fully parallelizable with a matrix memory and a covariance update rule. Integrating these LSTM extensions into residual block backbones yields xLSTM blocks that are then residually stacked into xLSTM architectures. Exponential gating and modified memory structures boost xLSTM capabilities to perform favorably when compared to state-of-the-art Transformers and State Space Models, both in performance and scaling. △ Less

Submitted 6 December, 2024; v1 submitted 7 May, 2024; originally announced May 2024.

Comments: Code available at https://github.com/NX-AI/xlstm

The variability patterns of the TeV blazar PG 1553+113 from a decade of MAGIC and multi-band observations

Authors: MAGIC Collaboration, H. Abe, S. Abe, J. Abhir, V. A. Acciari, I. Agudo, T. Aniello, S. Ansoldi, L. A. Antonelli, A. Arbet Engels, C. Arcaro, M. Artero, K. Asano, D. Baack, A. Babić, A. Baquero, U. Barres de Almeida, I. Batković, J. Baxter, J. Becerra González, E. Bernardini, J. Bernete, A. Berti, J. Besenrieder, C. Bigongiari , et al. (242 additional authors not shown)

Abstract: PG 1553+113 is one of the few blazars with a convincing quasi-periodic emission in the gamma-ray band. The source is also a very high-energy (VHE; >100 GeV) gamma-ray emitter. To better understand its properties and identify the underlying physical processes driving its variability, the MAGIC Collaboration initiated a multiyear, multiwavelength monitoring campaign in 2015 involving the OVRO 40-m a… ▽ More PG 1553+113 is one of the few blazars with a convincing quasi-periodic emission in the gamma-ray band. The source is also a very high-energy (VHE; >100 GeV) gamma-ray emitter. To better understand its properties and identify the underlying physical processes driving its variability, the MAGIC Collaboration initiated a multiyear, multiwavelength monitoring campaign in 2015 involving the OVRO 40-m and Medicina radio telescopes, REM, KVA, and the MAGIC telescopes, Swift and Fermi satellites, and the WEBT network. The analysis presented in this paper uses data until 2017 and focuses on the characterization of the variability. The gamma-ray data show a (hint of a) periodic signal compatible with literature, but the X-ray and VHE gamma-ray data do not show statistical evidence for a periodic signal. In other bands, the data are compatible with the gamma-ray period, but with a relatively high p-value. The complex connection between the low and high-energy emission and the non-monochromatic modulation and changes in flux suggests that a simple one-zone model is unable to explain all the variability. Instead, a model including a periodic component along with multiple emission zones is required. △ Less

Submitted 4 March, 2024; originally announced March 2024.

Comments: Accepted for publication in Monthly Notices of the Royal Astronomical Society. 19 pages, 9 figures. Corresponding authors: Elisa Prandini, Antonio Stamerra, Talvikki Hovatta

Magnetism, heat capacity and electronic structure of EuCd$_2$P$_2$ in view of its colossal magnetoresistance

Authors: Dmitry Yu. Usachov, Sarah Krebber, Kirill A. Bokai, Artem V. Tarasov, Marvin Kopp, Charu Garg, Alexander Virovets, Jens Müller, Max Mende, Georg Poelchen, Denis V. Vyalikh, Cornelius Krellner, Kristin Kliemt

Abstract: The mechanism of the peculiar transport properties around the magnetic ordering temperature of semiconducting antiferromagnetic EuCd$_2$P$_2$ is not yet understood. With a huge peak in the resistivity observed above the Néel temperature, $T_{\rm N}=10.6\,\rm K$, it exhibits a colossal magnetoresistance effect. Recent reports on observations of ferromagnetic contributions above $T_{\rm N}$ as well… ▽ More The mechanism of the peculiar transport properties around the magnetic ordering temperature of semiconducting antiferromagnetic EuCd$_2$P$_2$ is not yet understood. With a huge peak in the resistivity observed above the Néel temperature, $T_{\rm N}=10.6\,\rm K$, it exhibits a colossal magnetoresistance effect. Recent reports on observations of ferromagnetic contributions above $T_{\rm N}$ as well as metallic behavior below this temperature have motivated us to perform a comprehensive characterization of this material, including its resistivity, heat capacity, magnetic properties and electronic structure. Our transport measurements revealed quite different temperature dependence of resistivity with the maximum at $14\,\rm K$ instead of previously reported $18\,\rm K$. Low-field susceptibility data support the presence of static ferromagnetism above $T_{\rm N}$ and show a complex behavior of the material at small applied magnetic fields. Namely, signatures of reorientation of magnetic domains are observed up to $T=16\,\rm K$. Our magnetization measurements indicate a magnetocrystalline anisotropy which also leads to a preferred alignment of the magnetic clusters above $T_{\rm N}$. The momentum-resolved photoemission experiments at temperatures from $24\,\rm K$ down to $2.5\,\rm K$ indicate the permanent presence of a fundamental band gap without change of the electronic structure when going through $T_N$ that is in contradiction with previous results. We performed \textit{ab initio} band structure calculations which are in good agreement with the measured photoemission data when assuming an antiferromagnetic ground state. Calculations for the ferromagnetic phase show a much smaller bandgap, indicating the importance of possible ferromagnetic contributions for the explanation of the colossal magnetoresistance effect in the related EuZn$_2$P$_2$. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Comments: 13 pages, 9 figures

The classical field approximation of ultra light dark matter: quantum breaktimes, corrections, and decoherence

Authors: Andrew Eberhardt, Alvaro Zamora, Michael Kopp, Tom Abel

Abstract: The classical field approximation is widely used to better understand the predictions of ultra-light dark matter. Here, we use the truncated Wigner approximation method to test the classical field approximation of ultra-light dark matter. This method approximates a quantum state as an ensemble of independently evolving realizations drawn from its Wigner function. The method is highly parallelizabl… ▽ More The classical field approximation is widely used to better understand the predictions of ultra-light dark matter. Here, we use the truncated Wigner approximation method to test the classical field approximation of ultra-light dark matter. This method approximates a quantum state as an ensemble of independently evolving realizations drawn from its Wigner function. The method is highly parallelizable and allows the direct simulation of quantum corrections and decoherence times in systems many times larger than have been previously studied in reference to ultra-light dark matter. Our study involves simulation of systems in 1, 2, and 3 spatial dimensions. We simulate three systems, the condensation of a Gaussian random field in three spatial dimensions, a stable collapsed object in three spatial dimensions, and the merging of two stable objects in two spatial dimensions. We study the quantum corrections to the classical field theory in each case. We find that quantum corrections grow exponentially during nonlinear growth with the timescale being approximately equal to the system dynamical time. In stable systems the corrections grow quadratically. We also find that the primary effect of quantum corrections is to reduce the amplitude of fluctuations on the deBroglie scale in the spatial density. Finally, we find that the timescale associated with decoherence due to gravitational coupling to Baryonic matter is at least as fast as the quantum corrections due to gravitational interactions. These results strongly imply that quantum corrections do not impact the predictions of the classical field theory. △ Less

Submitted 10 October, 2023; originally announced October 2023.

Comments: to be submitted to phys rev d

Implicit Incorporation of Heuristics in MPC-Based Control of a Hydrogen Plant

Authors: Thomas Schmitt, Jens Engel, Martin Kopp, Tobias Rodemann

Abstract: The replacement of fossil fuels in combination with an increasing share of renewable energy sources leads to an increased focus on decentralized microgrids. One option is the local production of green hydrogen in combination with fuel cell vehicles (FCVs). In this paper, we develop a control strategy based on Model Predictive Control (MPC) for an energy management system (EMS) of a hydrogen plant,… ▽ More The replacement of fossil fuels in combination with an increasing share of renewable energy sources leads to an increased focus on decentralized microgrids. One option is the local production of green hydrogen in combination with fuel cell vehicles (FCVs). In this paper, we develop a control strategy based on Model Predictive Control (MPC) for an energy management system (EMS) of a hydrogen plant, which is currently under installation in Offenbach, Germany. The plant includes an electrolyzer, a compressor, a low pressure storage tank, and six medium pressure storage tanks with complex heuristic physical coupling during the filling and extraction of hydrogen. Since these heuristics are too complex to be incorporated into the optimal control problem (OCP) explicitly, we propose a novel approach to do so implicitly. First, the MPC is executed without considering them. Then, the so-called allocator uses a heuristic model (of arbitrary complexity) to verify whether the MPC's plan is valid. If not, it introduces additional constraints to the MPC's OCP to implicitly respect the tanks' pressure levels. The MPC is executed again and the new plan is applied to the plant. Simulation results with real-world measurement data of the facility's energy management and realistic fueling scenarios show its advantages over rule-based control. △ Less

Submitted 19 September, 2023; originally announced September 2023.

Comments: 8 pages, 3 figures. To be published in IEEE 3rd International Conference on Power Electronics, Smart Grid, and Renewable Energy (PESGRE 2023) proceedings

The impact of the AI revolution on asset management

Authors: Michael Kopp

Abstract: Recent progress in deep learning, a special form of machine learning, has led to remarkable capabilities machines can now be endowed with: they can read and understand free flowing text, reason and bargain with human counterparts, translate texts between languages, learn how to take decisions to maximize certain outcomes, etc. Today, machines have revolutionized the detection of cancer, the predic… ▽ More Recent progress in deep learning, a special form of machine learning, has led to remarkable capabilities machines can now be endowed with: they can read and understand free flowing text, reason and bargain with human counterparts, translate texts between languages, learn how to take decisions to maximize certain outcomes, etc. Today, machines have revolutionized the detection of cancer, the prediction of protein structures, the design of drugs, the control of nuclear fusion reactors etc. Although these capabilities are still in their infancy, it seems clear that their continued refinement and application will result in a technological impact on nearly all social and economic areas of human activity, the likes of which we have not seen before. In this article, I will share my view as to how AI will likely impact asset management in general and I will provide a mental framework that will equip readers with a simple criterion to assess whether and to what degree a given fund really exploits deep learning and whether a large disruption risk from deep learning exist. △ Less

Submitted 24 April, 2023; v1 submitted 20 April, 2023; originally announced April 2023.

Comments: 6 pages, 1 figure

Dsfer-Net: A Deep Supervision and Feature Retrieval Network for Bitemporal Change Detection Using Modern Hopfield Networks

Authors: Shizhen Chang, Michael Kopp, Pedram Ghamisi, Bo Du

Abstract: Change detection, an essential application for high-resolution remote sensing images, aims to monitor and analyze changes in the land surface over time. Due to the rapid increase in the quantity of high-resolution remote sensing data and the complexity of texture features, several quantitative deep learning-based methods have been proposed. These methods outperform traditional change detection met… ▽ More Change detection, an essential application for high-resolution remote sensing images, aims to monitor and analyze changes in the land surface over time. Due to the rapid increase in the quantity of high-resolution remote sensing data and the complexity of texture features, several quantitative deep learning-based methods have been proposed. These methods outperform traditional change detection methods by extracting deep features and combining spatial-temporal information. However, reasonable explanations for how deep features improve detection performance are still lacking. In our investigations, we found that modern Hopfield network layers significantly enhance semantic understanding. In this paper, we propose a Deep Supervision and FEature Retrieval network (Dsfer-Net) for bitemporal change detection. Specifically, the highly representative deep features of bitemporal images are jointly extracted through a fully convolutional Siamese network. Based on the sequential geographical information of the bitemporal images, we designed a feature retrieval module to extract difference features and leverage discriminative information in a deeply supervised manner. Additionally, we observed that the deeply supervised feature retrieval module provides explainable evidence of the semantic understanding of the proposed network in its deep layers. Finally, our end-to-end network establishes a novel framework by aggregating retrieved features and feature pairs from different layers. Experiments conducted on three public datasets (LEVIR-CD, WHU-CD, and CDD) confirm the superiority of the proposed Dsfer-Net over other state-of-the-art methods. △ Less

Submitted 4 June, 2024; v1 submitted 3 April, 2023; originally announced April 2023.

Traffic4cast at NeurIPS 2022 -- Predict Dynamics along Graph Edges from Sparse Node Data: Whole City Traffic and ETA from Stationary Vehicle Detectors

Authors: Moritz Neun, Christian Eichenberger, Henry Martin, Markus Spanring, Rahul Siripurapu, Daniel Springer, Leyan Deng, Chenwang Wu, Defu Lian, Min Zhou, Martin Lumiste, Andrei Ilie, Xinhua Wu, Cheng Lyu, Qing-Long Lu, Vishal Mahajan, Yichao Lu, Jiezhang Li, Junjun Li, Yue-Jiao Gong, Florian Grötschla, Joël Mathys, Ye Wei, He Haitao, Hui Fang , et al. (5 additional authors not shown)

Abstract: The global trends of urbanization and increased personal mobility force us to rethink the way we live and use urban space. The Traffic4cast competition series tackles this problem in a data-driven way, advancing the latest methods in machine learning for modeling complex spatial systems over time. In this edition, our dynamic road graph data combine information from road maps, $10^{12}$ probe data… ▽ More The global trends of urbanization and increased personal mobility force us to rethink the way we live and use urban space. The Traffic4cast competition series tackles this problem in a data-driven way, advancing the latest methods in machine learning for modeling complex spatial systems over time. In this edition, our dynamic road graph data combine information from road maps, $10^{12}$ probe data points, and stationary vehicle detectors in three cities over the span of two years. While stationary vehicle detectors are the most accurate way to capture traffic volume, they are only available in few locations. Traffic4cast 2022 explores models that have the ability to generalize loosely related temporal vertex data on just a few nodes to predict dynamic future traffic states on the edges of the entire road graph. In the core challenge, participants are invited to predict the likelihoods of three congestion classes derived from the speed levels in the GPS data for the entire road graph in three cities 15 min into the future. We only provide vehicle count data from spatially sparse stationary vehicle detectors in these three cities as model input for this task. The data are aggregated in 15 min time bins for one hour prior to the prediction time. For the extended challenge, participants are tasked to predict the average travel times on super-segments 15 min into the future - super-segments are longer sequences of road segments in the graph. The competition results provide an important advance in the prediction of complex city-wide traffic states just from publicly available sparse vehicle data and without the need for large amounts of real-time floating vehicle data. △ Less

Submitted 14 March, 2023; originally announced March 2023.

Comments: Pre-print under review, submitted to Proceedings of Machine Learning Research

Colossal magnetoresistance in EuZn$_2$P$_2$ and its electronic and magnetic structure

Authors: Sarah Krebber, Marvin Kopp, Charu Garg, Kurt Kummer, Jörg Sichelschmidt, Susanne Schulz, Georg Poelchen, Max Mende, Alexander V. Virovets, Konstantin Warawa, Mark D. Thomson, Artem V. Tarasov, Dmitry Yu. Usachov, Denis V. Vyalikh, Hartmut G. Roskos, Jens Müller, Cornelius Krellner, Kristin Kliemt

Abstract: We investigate single crystals of the trigonal antiferromagnet EuZn$_2$P$_2$ ($P\overline{3}m1$) by means of electrical transport, magnetization measurements, X-ray magnetic scattering, optical reflectivity, angle-resolved photoemission spectroscopy (ARPES) and ab-initio band structure calculations (DFT+U). We find that the electrical resistivity of EuZn$_2$P$_2$ increases strongly upon cooling an… ▽ More We investigate single crystals of the trigonal antiferromagnet EuZn$_2$P$_2$ ($P\overline{3}m1$) by means of electrical transport, magnetization measurements, X-ray magnetic scattering, optical reflectivity, angle-resolved photoemission spectroscopy (ARPES) and ab-initio band structure calculations (DFT+U). We find that the electrical resistivity of EuZn$_2$P$_2$ increases strongly upon cooling and can be suppressed in magnetic fields by several orders of magnitude (CMR effect). Resonant magnetic scattering reveals a magnetic ordering vector of $q = (0\, 0\, \frac{1}{2})$, corresponding to an $A$-type antiferromagnetic (AFM) order, below $T_{\rm N} = 23.7\,\rm K$. We find that the moments are canted out of the $a-a$ plane by an angle of about $40^{\circ}\pm 10^{\circ}$ degrees and aligned along the [100] in the $a-a$ plane. We observe nearly isotropic magnetization behavior for low fields and low temperatures which is consistent with the magnetic scattering results. The magnetization measurements show a deviation from the Curie-Weiss behavior below $\approx 150\,\rm K$, the temperature below which also the field dependence of the material's resistivity starts to increase. An analysis of the infrared reflectivity spectrum at $T=295\,\rm K$ allows us to resolve the main phonon bands and intra-/interband transitions, and estimate indirect and direct band gaps of $E_i^{\mathrm{opt}}=0.09\,\rm{eV}$ and $E_d^{\mathrm{opt}}=0.33\,\rm{eV}$, respectively, which are in good agreement with the theoretically predicted ones. The experimental band structure obtained by ARPES is nearly $T$-independent above and below $T_{\rm N}$. The comparison of the theoretical and experimental data shows a weak intermixing of the Eu 4$f$ states close to the $Γ$ point with the bands formed by the phosphorous 3$p$ orbitals leading to an induction of a small magnetic moment at the P sites. △ Less

Submitted 16 August, 2023; v1 submitted 28 February, 2023; originally announced February 2023.

Metropolitan Segment Traffic Speeds from Massive Floating Car Data in 10 Cities

Authors: Moritz Neun, Christian Eichenberger, Yanan Xin, Cheng Fu, Nina Wiedemann, Henry Martin, Martin Tomko, Lukas Ambühl, Luca Hermes, Michael Kopp

Abstract: Traffic analysis is crucial for urban operations and planning, while the availability of dense urban traffic data beyond loop detectors is still scarce. We present a large-scale floating vehicle dataset of per-street segment traffic information, Metropolitan Segment Traffic Speeds from Massive Floating Car Data in 10 Cities (MeTS-10), available for 10 global cities with a 15-minute resolution for… ▽ More Traffic analysis is crucial for urban operations and planning, while the availability of dense urban traffic data beyond loop detectors is still scarce. We present a large-scale floating vehicle dataset of per-street segment traffic information, Metropolitan Segment Traffic Speeds from Massive Floating Car Data in 10 Cities (MeTS-10), available for 10 global cities with a 15-minute resolution for collection periods ranging between 108 and 361 days in 2019-2021 and covering more than 1500 square kilometers per metropolitan area. MeTS-10 features traffic speed information at all street levels from main arterials to local streets for Antwerp, Bangkok, Barcelona, Berlin, Chicago, Istanbul, London, Madrid, Melbourne and Moscow. The dataset leverages the industrial-scale floating vehicle Traffic4cast data with speeds and vehicle counts provided in a privacy-preserving spatio-temporal aggregation. We detail the efficient matching approach mapping the data to the OpenStreetMap road graph. We evaluate the dataset by comparing it with publicly available stationary vehicle detector data (for Berlin, London, and Madrid) and the Uber traffic speed dataset (for Barcelona, Berlin, and London). The comparison highlights the differences across datasets in spatio-temporal coverage and variations in the reported traffic caused by the binning method. MeTS-10 enables novel, city-wide analysis of mobility and traffic patterns for ten major world cities, overcoming current limitations of spatially sparse vehicle detector data. The large spatial and temporal coverage offers an opportunity for joining the MeTS-10 with other datasets, such as traffic surveys in traffic planning studies or vehicle detector data in traffic control settings. △ Less

Submitted 31 August, 2023; v1 submitted 17 February, 2023; originally announced February 2023.

Comments: Accepted by IEEE Transactions on Intelligent Transportation Systems (T-ITS), DOI: https://doi.org/10.1109/TITS.2023.3291737

Journal ref: IEEE Transactions on Intelligent Transportation Systems (T-ITS), 2023

Microstructuring YbRh2Si2 for resistance and noise measurements down to ultra-low temperatures

Authors: Alexander Steppke, Sandra Hamann, Markus König, Andrew P. Mackenzie, Kristin Kliemt, Cornelius Krellner, Marvin Kopp, Martin Lonsky, Jens Müller, Lev V. Levitin, John Saunders, Manuel Brando

Abstract: The discovery of superconductivity in the quantum critical Kondo-lattice system YbRh2Si2 at an extremely low temperature of 2 mK has inspired efforts to perform high-resolution electrical resistivity measurements down to this temperature range in highly conductive materials. Here we show that control over the sample geometry by microstructuring using focused-ion-beam (FIB) techniques allows to rea… ▽ More The discovery of superconductivity in the quantum critical Kondo-lattice system YbRh2Si2 at an extremely low temperature of 2 mK has inspired efforts to perform high-resolution electrical resistivity measurements down to this temperature range in highly conductive materials. Here we show that control over the sample geometry by microstructuring using focused-ion-beam (FIB) techniques allows to reach ultra-low temperatures and increase signal-to-noise ratios (SNR) tenfold, without adverse effects to sample quality. In five experiments we show four-terminal sensing resistance and magnetoresistance measurements which exhibit sharp phase transitions at the Néel temperature, and Shubnikov-de-Haas (SdH) oscillations between 13 T and 18 T where we identified a new SdH frequency of 0.39 kT. The increased SNR allowed resistance fluctuation (noise) spectroscopy that would not be possible for bulk crystals, and confirmed intrinsic 1/f-type fluctuations. Under controlled strain, two thin microstructured samples exhibited a large increase of T_N from 67 mK up to 188 mK while still showing clear signatures of the phase transition and SdH oscillations. SQUID-based thermal noise spectroscopy measurements in a nuclear demagnetisation refrigerator down to 0.95 mK, show a sharp superconducting transition at T_c = 1.2 mK. These experiments demonstrate microstructuring as a powerful tool to investigate the resistance and the noise spectrum of highly conductive correlated metals over wide temperature ranges. △ Less

Submitted 10 January, 2023; originally announced January 2023.

Comments: 23 pages, 7 figures

Journal ref: New Journal of Physics 24 (2022) 123033

Profiling and Improving the PyTorch Dataloader for high-latency Storage: A Technical Report

Authors: Ivan Svogor, Christian Eichenberger, Markus Spanring, Moritz Neun, Michael Kopp

Abstract: A growing number of Machine Learning Frameworks recently made Deep Learning accessible to a wider audience of engineers, scientists, and practitioners, by allowing straightforward use of complex neural network architectures and algorithms. However, since deep learning is rapidly evolving, not only through theoretical advancements but also with respect to hardware and software engineering, ML frame… ▽ More A growing number of Machine Learning Frameworks recently made Deep Learning accessible to a wider audience of engineers, scientists, and practitioners, by allowing straightforward use of complex neural network architectures and algorithms. However, since deep learning is rapidly evolving, not only through theoretical advancements but also with respect to hardware and software engineering, ML frameworks often lose backward compatibility and introduce technical debt that can lead to bottlenecks and sub-optimal resource utilization. Moreover, the focus is in most cases not on deep learning engineering, but rather on new models and theoretical advancements. In this work, however, we focus on engineering, more specifically on the data loading pipeline in the PyTorch Framework. We designed a series of benchmarks that outline performance issues of certain steps in the data loading process. Our findings show that for classification tasks that involve loading many files, like images, the training wall-time can be significantly improved. With our new, modified ConcurrentDataloader we can reach improvements in GPU utilization and significantly reduce batch loading time, up to 12X. This allows for the use of the cloud-based, S3-like object storage for datasets, and have comparable training time as if datasets are stored on local drives. △ Less

Submitted 7 December, 2022; v1 submitted 9 November, 2022; originally announced November 2022.

Testing the mean field theory of scalar field dark matter

Authors: Andrew Eberhardt, Alvaro Zamora, Michael Kopp, Tom Abel

Abstract: Scalar field dark matter offers an interesting alternative to the traditional WIMP dark matter picture. Astrophysical and cosmological simulations are useful to constraining the mass of the dark matter particle in this model. This is particularly true at low mass where the wavelike nature of the dark matter particle manifests on astrophysical scales. These simulations typical use a classical field… ▽ More Scalar field dark matter offers an interesting alternative to the traditional WIMP dark matter picture. Astrophysical and cosmological simulations are useful to constraining the mass of the dark matter particle in this model. This is particularly true at low mass where the wavelike nature of the dark matter particle manifests on astrophysical scales. These simulations typical use a classical field approximation. In this work, we look at extending these simulations to include quantum corrections. We look into both the ways in which large corrections impact the predictions of scalar field dark matter, and the timescales on which these corrections grow large. Corrections tend to lessen density fluctuations and increase the effect of "quantum pressure". During collapse, these corrections grow exponentially, quantum corrections would become important in about ~30 dynamical times. This implies that the predictions of classical field simulations may differ from those with quantum corrections for systems with short dynamical times. △ Less

Submitted 11 October, 2022; originally announced October 2022.

Comments: IDM conference proceedings

Sketched Multi-view Subspace Learning for Hyperspectral Anomalous Change Detection

Authors: Shizhen Chang, Michael Kopp, Pedram Ghamisi

Abstract: In recent years, multi-view subspace learning has been garnering increasing attention. It aims to capture the inner relationships of the data that are collected from multiple sources by learning a unified representation. In this way, comprehensive information from multiple views is shared and preserved for the generalization processes. As a special branch of temporal series hyperspectral image (HS… ▽ More In recent years, multi-view subspace learning has been garnering increasing attention. It aims to capture the inner relationships of the data that are collected from multiple sources by learning a unified representation. In this way, comprehensive information from multiple views is shared and preserved for the generalization processes. As a special branch of temporal series hyperspectral image (HSI) processing, the anomalous change detection task focuses on detecting very small changes among different temporal images. However, when the volume of datasets is very large or the classes are relatively comprehensive, existing methods may fail to find those changes between the scenes, and end up with terrible detection results. In this paper, inspired by the sketched representation and multi-view subspace learning, a sketched multi-view subspace learning (SMSL) model is proposed for HSI anomalous change detection. The proposed model preserves major information from the image pairs and improves computational complexity by using a sketched representation matrix. Furthermore, the differences between scenes are extracted by utilizing the specific regularizer of the self-representation matrices. To evaluate the detection effectiveness of the proposed SMSL model, experiments are conducted on a benchmark hyperspectral remote sensing dataset and a natural hyperspectral dataset, and compared with other state-of-the art approaches. △ Less

Submitted 9 October, 2022; originally announced October 2022.

Multi-messenger characterization of Mrk 501 during historically low X-ray and $γ$-ray activity

Authors: MAGIC collaboration, H. Abe, S. Abe, V. A. Acciari, I. Agudo, T. Aniello, S. Ansoldi, L. A. Antonelli, A. Arbet Engels, C. Arcaro, M. Artero, K. Asano, D. Baack, A. Babić, A. Baquero, U. Barres de Almeida, J. A. Barrio, I. Batković, J. Baxter, J. Becerra González, W. Bednarek, E. Bernardini, M. Bernardos, A. Berti, J. Besenrieder , et al. (300 additional authors not shown)

Abstract: We study the broadband emission of Mrk 501 using multi-wavelength observations from 2017 to 2020 performed with a multitude of instruments, involving, among others, MAGIC, Fermi-LAT, NuSTAR, Swift, GASP-WEBT, and OVRO. Mrk 501 showed an extremely low broadband activity, which may help to unravel its baseline emission. Nonetheless, significant flux variations are detected at all wavebands, with the… ▽ More We study the broadband emission of Mrk 501 using multi-wavelength observations from 2017 to 2020 performed with a multitude of instruments, involving, among others, MAGIC, Fermi-LAT, NuSTAR, Swift, GASP-WEBT, and OVRO. Mrk 501 showed an extremely low broadband activity, which may help to unravel its baseline emission. Nonetheless, significant flux variations are detected at all wavebands, with the highest occurring at X-rays and very-high-energy (VHE) $γ$-rays. A significant correlation ($>$3$σ$) between X-rays and VHE $γ$-rays is measured, supporting leptonic scenarios to explain the variable parts of the emission, also during low activity. This is further supported when we extend our data from 2008 to 2020, and identify, for the first time, significant correlations between Swift-XRT and Fermi-LAT. We additionally find correlations between high-energy $γ$-rays and radio, with the radio lagging by more than 100 days, placing the $γ$-ray emission zone upstream of the radio-bright regions in the jet. Furthermore, Mrk 501 showed a historically low activity in X-rays and VHE $γ$-rays from mid-2017 to mid-2019 with a stable VHE flux ($>$0.2 TeV) of 5% the emission of the Crab Nebula. The broadband spectral energy distribution (SED) of this 2-year-long low-state, the potential baseline emission of Mrk 501, can be characterized with one-zone leptonic models, and with (lepto)-hadronic models fulfilling neutrino flux constraints from IceCube. We explore the time evolution of the SED towards the low-state, revealing that the stable baseline emission may be ascribed to a standing shock, and the variable emission to an additional expanding or traveling shock. △ Less

Submitted 5 March, 2023; v1 submitted 5 October, 2022; originally announced October 2022.

Comments: 55 pages, 30 figures, 14 tables, accepted by APJS. Corresponding authors are L. Heckmann, D. Paneque, S. Gasparyan, M. Cerruti, and N. Sahakyan

Journal ref: ApJS 266 37 (2023)

Predicting the Future of AI with AI: High-quality link prediction in an exponentially growing knowledge network

Authors: Mario Krenn, Lorenzo Buffoni, Bruno Coutinho, Sagi Eppel, Jacob Gates Foster, Andrew Gritsevskiy, Harlin Lee, Yichao Lu, Joao P. Moutinho, Nima Sanjabi, Rishi Sonthalia, Ngoc Mai Tran, Francisco Valente, Yangxinyu Xie, Rose Yu, Michael Kopp

Abstract: A tool that could suggest new personalized research directions and ideas by taking insights from the scientific literature could significantly accelerate the progress of science. A field that might benefit from such an approach is artificial intelligence (AI) research, where the number of scientific publications has been growing exponentially over the last years, making it challenging for human re… ▽ More A tool that could suggest new personalized research directions and ideas by taking insights from the scientific literature could significantly accelerate the progress of science. A field that might benefit from such an approach is artificial intelligence (AI) research, where the number of scientific publications has been growing exponentially over the last years, making it challenging for human researchers to keep track of the progress. Here, we use AI techniques to predict the future research directions of AI itself. We develop a new graph-based benchmark based on real-world data -- the Science4Cast benchmark, which aims to predict the future state of an evolving semantic network of AI. For that, we use more than 100,000 research papers and build up a knowledge network with more than 64,000 concept nodes. We then present ten diverse methods to tackle this task, ranging from pure statistical to pure learning methods. Surprisingly, the most powerful methods use a carefully curated set of network features, rather than an end-to-end AI approach. It indicates a great potential that can be unleashed for purely ML approaches without human knowledge. Ultimately, better predictions of new future research directions will be a crucial component of more advanced research suggestion tools. △ Less

Submitted 23 September, 2022; originally announced October 2022.

Comments: 13 pages, 7 figures. Comments welcome!

Journal ref: Nature Machine Intelligence 5, 1326 (2023)

Txt2Img-MHN: Remote Sensing Image Generation from Text Using Modern Hopfield Networks

Authors: Yonghao Xu, Weikang Yu, Pedram Ghamisi, Michael Kopp, Sepp Hochreiter

Abstract: The synthesis of high-resolution remote sensing images based on text descriptions has great potential in many practical application scenarios. Although deep neural networks have achieved great success in many important remote sensing tasks, generating realistic remote sensing images from text descriptions is still very difficult. To address this challenge, we propose a novel text-to-image modern H… ▽ More The synthesis of high-resolution remote sensing images based on text descriptions has great potential in many practical application scenarios. Although deep neural networks have achieved great success in many important remote sensing tasks, generating realistic remote sensing images from text descriptions is still very difficult. To address this challenge, we propose a novel text-to-image modern Hopfield network (Txt2Img-MHN). The main idea of Txt2Img-MHN is to conduct hierarchical prototype learning on both text and image embeddings with modern Hopfield layers. Instead of directly learning concrete but highly diverse text-image joint feature representations for different semantics, Txt2Img-MHN aims to learn the most representative prototypes from text-image embeddings, achieving a coarse-to-fine learning strategy. These learned prototypes can then be utilized to represent more complex semantics in the text-to-image generation task. To better evaluate the realism and semantic consistency of the generated images, we further conduct zero-shot classification on real remote sensing data using the classification model trained on synthesized images. Despite its simplicity, we find that the overall accuracy in the zero-shot classification may serve as a good metric to evaluate the ability to generate an image from text. Extensive experiments on the benchmark remote sensing text-image dataset demonstrate that the proposed Txt2Img-MHN can generate more realistic remote sensing images than existing methods. Code and pre-trained models are available online (https://github.com/YonghaoXu/Txt2Img-MHN). △ Less

Submitted 8 October, 2023; v1 submitted 8 August, 2022; originally announced August 2022.

Journal ref: IEEE Trans. Image Process., vol. 32, pp. 5737-5750, 2023

When quantum corrections alter the predictions of classical field theory for scalar field dark matter

Authors: Andrew Eberhardt, Michael Kopp, Tom Abel

Abstract: We investigate the timescale on which quantum corrections alter the predictions of classical field theory for scalar field dark matter. This is accomplished by including second order terms in the evolution proportional to the covariance of the field operators. When this covariance is no longer small compared to the mean field value, we say that the system has reached the ``quantum breaktime" and t… ▽ More We investigate the timescale on which quantum corrections alter the predictions of classical field theory for scalar field dark matter. This is accomplished by including second order terms in the evolution proportional to the covariance of the field operators. When this covariance is no longer small compared to the mean field value, we say that the system has reached the ``quantum breaktime" and the predictions of classical field theory will begin to differ from those of the full quantum theory. While holding the classical field theory evolution fixed, we determine the change of the quantum breaktime as total occupation number is increased. This provides a novel numerical estimation of the breaktime based at high occupations $n_{tot}$ and mode number $N=256$. We study the collapse of a sinusoidal overdensity in a single spatial dimension. We find that the breaktime scales as $\log(n_{tot})$ prior to shell crossing and then then as a powerlaw following the collapse. If we assume that the collapsing phase is representative of halos undergoing nonlinear growth, this implies that the quantum breaktime of typical systems may be as large as $\sim 30$ of dynamical times even at occupations of $n_{tot}\sim 10^{100}$. △ Less

Submitted 13 June, 2022; originally announced June 2022.

Comments: to be submitted to Phys Rev D

On inference of quantization from gravitationally induced entanglement

Authors: Vasileios Fragkos, Michael Kopp, Igor Pikovski

Abstract: Observable signatures of the quantum nature of gravity at low energies have recently emerged as a promising new research field. One prominent avenue is to test for gravitationally induced entanglement between two mesoscopic masses prepared in spatial superposition. Here we analyze such proposals and what one can infer from them about the quantum nature of gravity, as well as the electromagnetic an… ▽ More Observable signatures of the quantum nature of gravity at low energies have recently emerged as a promising new research field. One prominent avenue is to test for gravitationally induced entanglement between two mesoscopic masses prepared in spatial superposition. Here we analyze such proposals and what one can infer from them about the quantum nature of gravity, as well as the electromagnetic analogues of such tests. We show that it is not possible to draw conclusions about mediators: even within relativistic physics, entanglement generation can equally be described in terms of mediators or in terms of non-local processes -- relativity does not dictate a local channel. Such indirect tests therefore have limited ability to probe the nature of the process establishing the entanglement as their interpretation is inherently ambiguous. We also show that cosmological observations already demonstrate some aspects of quantization that these proposals aim to test. Nevertheless, the proposed experiments would probe how gravity is sourced by spatial superpositions of matter, an untested new regime of quantum physics. △ Less

Submitted 15 February, 2023; v1 submitted 1 June, 2022; originally announced June 2022.

Comments: 23 pages, 3 figures

Journal ref: AVS Quantum Sci. 4, 045601 (2022)

Landslide4Sense: Reference Benchmark Data and Deep Learning Models for Landslide Detection

Authors: Omid Ghorbanzadeh, Yonghao Xu, Pedram Ghamisi, Michael Kopp, David Kreil

Abstract: This study introduces \textit{Landslide4Sense}, a reference benchmark for landslide detection from remote sensing. The repository features 3,799 image patches fusing optical layers from Sentinel-2 sensors with the digital elevation model and slope layer derived from ALOS PALSAR. The added topographical information facilitates the accurate detection of landslide borders, which recent researches hav… ▽ More This study introduces \textit{Landslide4Sense}, a reference benchmark for landslide detection from remote sensing. The repository features 3,799 image patches fusing optical layers from Sentinel-2 sensors with the digital elevation model and slope layer derived from ALOS PALSAR. The added topographical information facilitates the accurate detection of landslide borders, which recent researches have shown to be challenging using optical data alone. The extensive data set supports deep learning (DL) studies in landslide detection and the development and validation of methods for the systematic update of landslide inventories. The benchmark data set has been collected at four different times and geographical locations: Iburi (September 2018), Kodagu (August 2018), Gorkha (April 2015), and Taiwan (August 2009). Each image pixel is labelled as belonging to a landslide or not, incorporating various sources and thorough manual annotation. We then evaluate the landslide detection performance of 11 state-of-the-art DL segmentation models: U-Net, ResU-Net, PSPNet, ContextNet, DeepLab-v2, DeepLab-v3+, FCN-8s, LinkNet, FRRN-A, FRRN-B, and SQNet. All models were trained from scratch on patches from one quarter of each study area and tested on independent patches from the other three quarters. Our experiments demonstrate that ResU-Net outperformed the other models for the landslide detection task. We make the multi-source landslide benchmark data (Landslide4Sense) and the tested DL models publicly available at \url{https://www.iarai.ac.at/landslide4sense}, establishing an important resource for remote sensing, computer vision, and machine learning communities in studies of image classification in general and applications to landslide detection in particular. △ Less

Submitted 20 December, 2022; v1 submitted 1 June, 2022; originally announced June 2022.

Journal ref: IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-17, 2022

Traffic4cast at NeurIPS 2021 -- Temporal and Spatial Few-Shot Transfer Learning in Gridded Geo-Spatial Processes

Authors: Christian Eichenberger, Moritz Neun, Henry Martin, Pedro Herruzo, Markus Spanring, Yichao Lu, Sungbin Choi, Vsevolod Konyakhin, Nina Lukashina, Aleksei Shpilman, Nina Wiedemann, Martin Raubal, Bo Wang, Hai L. Vu, Reza Mohajerpoor, Chen Cai, Inhi Kim, Luca Hermes, Andrew Melnik, Riza Velioglu, Markus Vieth, Malte Schilling, Alabi Bojesomo, Hasan Al Marzouqi, Panos Liatsis , et al. (12 additional authors not shown)

Abstract: The IARAI Traffic4cast competitions at NeurIPS 2019 and 2020 showed that neural networks can successfully predict future traffic conditions 1 hour into the future on simply aggregated GPS probe data in time and space bins. We thus reinterpreted the challenge of forecasting traffic conditions as a movie completion task. U-Nets proved to be the winning architecture, demonstrating an ability to extra… ▽ More The IARAI Traffic4cast competitions at NeurIPS 2019 and 2020 showed that neural networks can successfully predict future traffic conditions 1 hour into the future on simply aggregated GPS probe data in time and space bins. We thus reinterpreted the challenge of forecasting traffic conditions as a movie completion task. U-Nets proved to be the winning architecture, demonstrating an ability to extract relevant features in this complex real-world geo-spatial process. Building on the previous competitions, Traffic4cast 2021 now focuses on the question of model robustness and generalizability across time and space. Moving from one city to an entirely different city, or moving from pre-COVID times to times after COVID hit the world thus introduces a clear domain shift. We thus, for the first time, release data featuring such domain shifts. The competition now covers ten cities over 2 years, providing data compiled from over 10^12 GPS probe data. Winning solutions captured traffic dynamics sufficiently well to even cope with these complex domain shifts. Surprisingly, this seemed to require only the previous 1h traffic dynamic history and static road graph as input. △ Less

Submitted 1 April, 2022; v1 submitted 31 March, 2022; originally announced March 2022.

Comments: Pre-print under review, submitted to Proceedings of Machine Learning Research

Diffusion evolution of a pore in bounded particle in a hydrogen atmosphere

Authors: M. I. Kopp, P. N. Ostapchuk, V. V. Yanovsky

Abstract: The problem of the diffusion evolution of a pore filled with molecular hydrogen in a spherical granule in a hydrogen medium is solved. The initial position of the pore is displaced relative to the center of the granule. A nonlinear system of equations is obtained, which describes the behavior of the size of the gas-filled pore, the amount of gas in it and its position relative to the center of the… ▽ More The problem of the diffusion evolution of a pore filled with molecular hydrogen in a spherical granule in a hydrogen medium is solved. The initial position of the pore is displaced relative to the center of the granule. A nonlinear system of equations is obtained, which describes the behavior of the size of the gas-filled pore, the amount of gas in it and its position relative to the center of the bounded particle with time. Numerical calculations have shown the existence of two stages of evolution. The first (fast) stage is associated with the equalization of pressure in the pore with the external. The second is the slow diffusion "healing" of the pore, when the amount of gas adjusts to its size and the gas pressure is approximately equal to the external. △ Less

Submitted 30 March, 2022; originally announced March 2022.

Comments: 10 pages, 4 figures. arXiv admin note: text overlap with arXiv:1910.13956

A framework for comprehensible multi-modal detection of cyber threats

Authors: Jan Kohout, Čeněk Škarda, Kyrylo Shcherbin, Martin Kopp, Jan Brabec

Abstract: Detection of malicious activities in corporate environments is a very complex task and much effort has been invested into research of its automation. However, vast majority of existing methods operate only in a narrow scope which limits them to capture only fragments of the evidence of malware's presence. Consequently, such approach is not aligned with the way how the cyber threats are studied and… ▽ More Detection of malicious activities in corporate environments is a very complex task and much effort has been invested into research of its automation. However, vast majority of existing methods operate only in a narrow scope which limits them to capture only fragments of the evidence of malware's presence. Consequently, such approach is not aligned with the way how the cyber threats are studied and described by domain experts. In this work, we discuss these limitations and design a detection framework which combines observed events from different sources of data. Thanks to this, it provides full insight into the attack life cycle and enables detection of threats that require this coupling of observations from different telemetries to identify the full scope of the incident. We demonstrate applicability of the framework on a case study of a real malware infection observed in a corporate network. △ Less

Submitted 10 November, 2021; originally announced November 2021.

On the single classical field description of interacting scalar fields

Authors: Andrew Eberhardt, Alvaro Zamora, Michael Kopp, Tom Abel

Abstract: We test the degree to which interacting Bosonic systems can be approximated by a classical field as total occupation number is increased. This is done with our publicly available code repository, \href{https://github.com/andillio/QIBS}{QIBS}, a massively parallel solver for these systems. We use a number of toy models well studied in the literature and track when the classical field description ad… ▽ More We test the degree to which interacting Bosonic systems can be approximated by a classical field as total occupation number is increased. This is done with our publicly available code repository, \href{https://github.com/andillio/QIBS}{QIBS}, a massively parallel solver for these systems. We use a number of toy models well studied in the literature and track when the classical field description admits quantum corrections, called the quantum breaktime. This allows us to test claims in the literature regarding the rate of convergence of these systems to the classical evolution. We test a number of initial conditions, including coherent states, number eigenstates, and field number states. We find that of these initial conditions, only number eigenstates do not converge to the classical evolution as occupation number is increased. We find that systems most similar to scalar field dark matter exhibit a logarithmic enhancement in the quantum breaktime with total occupation number. Systems with contact interactions or with field number state initial conditions, and linear dispersions, exhibit a power law enhancement. Finally, we find that the breaktime scaling depends on both model interactions and initial conditions. △ Less

Submitted 29 October, 2021; originally announced November 2021.

Comments: To be submitted to Phys Rev D

CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP

Authors: Andreas Fürst, Elisabeth Rumetshofer, Johannes Lehner, Viet Tran, Fei Tang, Hubert Ramsauer, David Kreil, Michael Kopp, Günter Klambauer, Angela Bitto-Nemling, Sepp Hochreiter

Abstract: CLIP yielded impressive results on zero-shot transfer learning tasks and is considered as a foundation model like BERT or GPT3. CLIP vision models that have a rich representation are pre-trained using the InfoNCE objective and natural language supervision before they are fine-tuned on particular tasks. Though CLIP excels at zero-shot transfer learning, it suffers from an explaining away problem, t… ▽ More CLIP yielded impressive results on zero-shot transfer learning tasks and is considered as a foundation model like BERT or GPT3. CLIP vision models that have a rich representation are pre-trained using the InfoNCE objective and natural language supervision before they are fine-tuned on particular tasks. Though CLIP excels at zero-shot transfer learning, it suffers from an explaining away problem, that is, it focuses on one or few features, while neglecting other relevant features. This problem is caused by insufficiently extracting the covariance structure in the original multi-modal data. We suggest to use modern Hopfield networks to tackle the problem of explaining away. Their retrieved embeddings have an enriched covariance structure derived from co-occurrences of features in the stored embeddings. However, modern Hopfield networks increase the saturation effect of the InfoNCE objective which hampers learning. We propose to use the InfoLOOB objective to mitigate this saturation effect. We introduce the novel "Contrastive Leave One Out Boost" (CLOOB), which uses modern Hopfield networks for covariance enrichment together with the InfoLOOB objective. In experiments we compare CLOOB to CLIP after pre-training on the Conceptual Captions and the YFCC dataset with respect to their zero-shot transfer learning performance on other datasets. CLOOB consistently outperforms CLIP at zero-shot transfer learning across all considered architectures and datasets. △ Less

Submitted 7 November, 2022; v1 submitted 21 October, 2021; originally announced October 2021.

Comments: Published at NeurIPS 2022; Blog: https://ml-jku.github.io/cloob; GitHub: https://github.com/ml-jku/cloob

Field moment expansion method for interacting Bosonic systems

Authors: Andrew Eberhardt, Michael Kopp, Alvaro Zamora, Tom Abel

Abstract: We introduce a numerical method and python package, https://github.com/andillio/CHiMES, that simulates quantum systems initially well approximated by mean field theory using a second order extension of the classical field approach. We call this the field moment expansion method. In this way, we can accurately approximate the evolution of first and second field moments beyond where the mean field t… ▽ More We introduce a numerical method and python package, https://github.com/andillio/CHiMES, that simulates quantum systems initially well approximated by mean field theory using a second order extension of the classical field approach. We call this the field moment expansion method. In this way, we can accurately approximate the evolution of first and second field moments beyond where the mean field theory breaks down. This allows us to estimate the quantum breaktime of a classical approximation without any calculations external to the theory. We investigate the accuracy of the field moment expansion using a number of well studied quantum test problems. Interacting Bosonic systems similar to scalar field dark matter are chosen as test problems. We find that successful application of this method depends on two conditions: the quantum system must initially be well described by the classical theory, and that the growth of the higher order moments be hierarchical. △ Less

Submitted 28 October, 2021; v1 submitted 19 August, 2021; originally announced August 2021.

Comments: Accepted to Phys. Rev. D

Journal ref: Phys. Rev. D 104, 083007 (2021)

Cluster Representatives Selection in Non-Metric Spaces for Nearest Prototype Classification

Authors: Jaroslav Hlaváč, Martin Kopp, Jan Kohout

Abstract: The nearest prototype classification is a less computationally intensive replacement for the $k$-NN method, especially when large datasets are considered. In metric spaces, centroids are often used as prototypes to represent whole clusters. The selection of cluster prototypes in non-metric spaces is more challenging as the idea of computing centroids is not directly applicable. In this paper, we… ▽ More The nearest prototype classification is a less computationally intensive replacement for the $k$-NN method, especially when large datasets are considered. In metric spaces, centroids are often used as prototypes to represent whole clusters. The selection of cluster prototypes in non-metric spaces is more challenging as the idea of computing centroids is not directly applicable. In this paper, we present CRS, a novel method for selecting a small yet representative subset of objects as a cluster prototype. Memory and computationally efficient selection of representatives is enabled by leveraging the similarity graph representation of each cluster created by the NN-Descent algorithm. CRS can be used in an arbitrary metric or non-metric space because of the graph-based approach, which requires only a pairwise similarity measure. As we demonstrate in the experimental evaluation, our method outperforms the state of the art techniques on multiple datasets from different domains. △ Less

Submitted 3 July, 2021; originally announced July 2021.

Learning Explainable Representations of Malware Behavior

Authors: Paul Prasse, Jan Brabec, Jan Kohout, Martin Kopp, Lukas Bajer, Tobias Scheffer

Abstract: We address the problems of identifying malware in network telemetry logs and providing \emph{indicators of compromise} -- comprehensible explanations of behavioral patterns that identify the threat. In our system, an array of specialized detectors abstracts network-flow data into comprehensible \emph{network events} in a first step. We develop a neural network that processes this sequence of event… ▽ More We address the problems of identifying malware in network telemetry logs and providing \emph{indicators of compromise} -- comprehensible explanations of behavioral patterns that identify the threat. In our system, an array of specialized detectors abstracts network-flow data into comprehensible \emph{network events} in a first step. We develop a neural network that processes this sequence of events and identifies specific threats, malware families and broad categories of malware. We then use the \emph{integrated-gradients} method to highlight events that jointly constitute the characteristic behavioral pattern of the threat. We compare network architectures based on CNNs, LSTMs, and transformers, and explore the efficacy of unsupervised pre-training experimentally on large-scale telemetry data. We demonstrate how this system detects njRAT and other malware based on behavioral patterns. △ Less

Submitted 23 June, 2021; originally announced June 2021.

Comments: This is a pre-print of an article to appear in Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2021

Investigation of the correlation patterns and the Compton dominance variability of Mrk 421 in 2017

Authors: MAGIC Collaboration, V. A. Acciari, S. Ansoldi, L. A. Antonelli, A. Arbet Engels, M. Artero, K. Asano, A. Babić, A. Baquero, U. Barres de Almeida, J. A. Barrio, I. Batković, J. Becerra González, W. Bednarek, L. Bellizzi, E. Bernardini, M. Bernardos, A. Berti, J. Besenrieder, W. Bhattacharyya, C. Bigongiari, O. Blanch, Ž. Bošnjak, G. Busetto, R. Carosi , et al. (263 additional authors not shown)

Abstract: We present a detailed characterisation and theoretical interpretation of the broadband emission of the paradigmatic TeV blazar Mrk 421, with special focus on the multi-band flux correlations. The dataset has been collected through an extensive multiwavelength campaign organised between 2016 December and 2017 June. The instruments involved are MAGIC, FACT, Fermi-LAT, Swift, GASP-WEBT, OVRO, Medicin… ▽ More We present a detailed characterisation and theoretical interpretation of the broadband emission of the paradigmatic TeV blazar Mrk 421, with special focus on the multi-band flux correlations. The dataset has been collected through an extensive multiwavelength campaign organised between 2016 December and 2017 June. The instruments involved are MAGIC, FACT, Fermi-LAT, Swift, GASP-WEBT, OVRO, Medicina and Metsähovi. Additionally, four deep exposures (several hours long) with simultaneous MAGIC and NuSTAR observations allowed a precise measurement of the falling segments of the two spectral components. The very-high-energy (VHE; E > 100 GeV) gamma rays and X-rays are positively correlated at zero time lag, but the strength and characteristics of the correlation change substantially across the various energy bands probed. The VHE versus X-ray fluxes follow different patterns, partly due to substantial changes in the Compton dominance during a few days without a simultaneous increase in the X-ray flux (i.e. orphan gamma-ray activity). Studying the broadband spectral energy distribution (SED) during the days including NuSTAR observations, we show that these changes can be explained within a one-zone leptonic model with a blob that increases its size over time. Our multi-band correlation study also hints at an anti-correlation between UV/optical and X-ray at a significance higher than 3 sigmas. A VHE flare observed on 2017 February 4 shows gamma-ray variability on multi-hour timescales, with a factor 10 increase in the TeV flux but only a moderate increase in the keV flux. The related broadband SED is better described by a two-zone leptonic scenario rather than by a one-zone scenario. We find that the flare can be produced by the appearance of a compact second blob populated by high energetic electrons spanning a narrow range of Lorentz factors. △ Less

Submitted 10 June, 2021; originally announced June 2021.

Comments: 38 pages, 23 figures, accepted for publication in Astronomy and Astrophysics. Corresponding authors: Axel Arbet-Engels, David Paneque

Journal ref: A&A 655, A89 (2021)

A remark on a paper of Krotov and Hopfield [arXiv:2008.06996]

Authors: Fei Tang, Michael Kopp

Abstract: In their recent paper titled "Large Associative Memory Problem in Neurobiology and Machine Learning" [arXiv:2008.06996] the authors gave a biologically plausible microscopic theory from which one can recover many dense associative memory models discussed in the literature. We show that the layers of the recent "MLP-mixer" [arXiv:2105.01601] as well as the essentially equivalent model in [arXiv:210… ▽ More In their recent paper titled "Large Associative Memory Problem in Neurobiology and Machine Learning" [arXiv:2008.06996] the authors gave a biologically plausible microscopic theory from which one can recover many dense associative memory models discussed in the literature. We show that the layers of the recent "MLP-mixer" [arXiv:2105.01601] as well as the essentially equivalent model in [arXiv:2105.02723] are amongst them. △ Less

Submitted 3 June, 2021; v1 submitted 31 May, 2021; originally announced May 2021.

Comments: 1 page, 8 formulae

Nonclassicality of axion-like dark matter through gravitational self-interactions

Authors: Michael Kopp, Vasileios Fragkos, Igor Pikovski

Abstract: Axion-like particles (ALPs) are promising dark matter candidates. They are typically described by a classical field, motivated by large phase space occupation numbers. Here we show that such a description is accompanied by a quantum effect: squeezing due to gravitational self-interactions. For a typical QCD axion today, the onset of squeezing is reached on $\mathrm{μs}$-scales and grows over mille… ▽ More Axion-like particles (ALPs) are promising dark matter candidates. They are typically described by a classical field, motivated by large phase space occupation numbers. Here we show that such a description is accompanied by a quantum effect: squeezing due to gravitational self-interactions. For a typical QCD axion today, the onset of squeezing is reached on $\mathrm{μs}$-scales and grows over millennia. Thus within the usual models based on the classical Schrödinger-Poisson equation, a type of Gross-Pitaevskii equation, any viable ALP is nonclassical. We also show that squeezing may be relevant on the scales of other self-gravitating systems such as galactic haloes, or solitonic cores. Conversely, our results highlight the incompleteness and limitations of the classical single field description of ALPs. △ Less

Submitted 11 August, 2022; v1 submitted 27 May, 2021; originally announced May 2021.

Comments: 13 pages, 3 figures, extended discussion and minor changes

Journal ref: Phys. Rev. D 106, 043517, 2022

Generation of magnetic fields by thermomagnetic effects in a nonuniformly rotating layer of an electrically conductive fluid

Authors: M. I. Kopp, K. N. Kulik, A. V. Tur, V. V. Yanovsky

Abstract: In this paper, the generation of magnetic fields in a nonuniformly rotating layer of finite thickness of an electrically conducting fluid by thermomagnetic (TM) instability. This instability arises due to the temperature gradient $\nabla T_0$ and thermoelectromotive coefficient gradient $\nablaα$. The influence of the generation of a toroidal magnetic field by TM instability on convective instabil… ▽ More In this paper, the generation of magnetic fields in a nonuniformly rotating layer of finite thickness of an electrically conducting fluid by thermomagnetic (TM) instability. This instability arises due to the temperature gradient $\nabla T_0$ and thermoelectromotive coefficient gradient $\nablaα$. The influence of the generation of a toroidal magnetic field by TM instability on convective instability in a nonuniformly rotating layer of an electrically conductive fluid in the presence of a vertical constant magnetic field ${\bf{B}}_0 \| {\rm OZ}$ is established. As a result of applying the method of perturbation theory for the small parameter $ ε= \sqrt {(\textrm {Ra}-\textrm {Ra}_c) / \textrm {Ra}_c} $ of supercriticality of the stationary Rayleigh number $\textrm {Ra}_c$ a nonlinear equation of the Ginzburg-Landau type was obtained. This equation describes the evolution of the finite amplitude of perturbations. Numerical solutions of this equation made it possible to determine the heat transfer in the fluid layer with and without TM effects. It is shown that the amplitude of the stationary toroidal magnetic field noticeably increases with allowance for TM effects. △ Less

Submitted 21 April, 2021; originally announced April 2021.

Comments: 32 pages, 9 figures

Cross-Domain Few-Shot Learning by Representation Fusion

Authors: Thomas Adler, Johannes Brandstetter, Michael Widrich, Andreas Mayr, David Kreil, Michael Kopp, Günter Klambauer, Sepp Hochreiter

Abstract: In order to quickly adapt to new data, few-shot learning aims at learning from few examples, often by using already acquired knowledge. The new data often differs from the previously seen data due to a domain shift, that is, a change of the input-target distribution. While several methods perform well on small domain shifts like new target classes with similar inputs, larger domain shifts are stil… ▽ More In order to quickly adapt to new data, few-shot learning aims at learning from few examples, often by using already acquired knowledge. The new data often differs from the previously seen data due to a domain shift, that is, a change of the input-target distribution. While several methods perform well on small domain shifts like new target classes with similar inputs, larger domain shifts are still challenging. Large domain shifts may result in high-level concepts that are not shared between the original and the new domain, whereas low-level concepts like edges in images might still be shared and useful. For cross-domain few-shot learning, we suggest representation fusion to unify different abstraction levels of a deep neural network into one representation. We propose Cross-domain Hebbian Ensemble Few-shot learning (CHEF), which achieves representation fusion by an ensemble of Hebbian learners acting on different layers of a deep neural network. Ablation studies show that representation fusion is a decisive factor to boost cross-domain few-shot learning. On the few-shot datasets miniImagenet and tieredImagenet with small domain shifts, CHEF is competitive with state-of-the-art methods. On cross-domain few-shot benchmark challenges with larger domain shifts, CHEF establishes novel state-of-the-art results in all categories. We further apply CHEF on a real-world cross-domain application in drug discovery. We consider a domain shift from bioactive molecules to environmental chemicals and drugs with twelve associated toxicity prediction tasks. On these tasks, that are highly relevant for computational drug discovery, CHEF significantly outperforms all its competitors. Github: https://github.com/ml-jku/chef △ Less

Submitted 16 February, 2021; v1 submitted 13 October, 2020; originally announced October 2020.

Hopfield Networks is All You Need

Authors: Hubert Ramsauer, Bernhard Schäfl, Johannes Lehner, Philipp Seidl, Michael Widrich, Thomas Adler, Lukas Gruber, Markus Holzleitner, Milena Pavlović, Geir Kjetil Sandve, Victor Greiff, David Kreil, Michael Kopp, Günter Klambauer, Johannes Brandstetter, Sepp Hochreiter

Abstract: We introduce a modern Hopfield network with continuous states and a corresponding update rule. The new Hopfield network can store exponentially (with the dimension of the associative space) many patterns, retrieves the pattern with one update, and has exponentially small retrieval errors. It has three types of energy minima (fixed points of the update): (1) global fixed point averaging over all pa… ▽ More We introduce a modern Hopfield network with continuous states and a corresponding update rule. The new Hopfield network can store exponentially (with the dimension of the associative space) many patterns, retrieves the pattern with one update, and has exponentially small retrieval errors. It has three types of energy minima (fixed points of the update): (1) global fixed point averaging over all patterns, (2) metastable states averaging over a subset of patterns, and (3) fixed points which store a single pattern. The new update rule is equivalent to the attention mechanism used in transformers. This equivalence enables a characterization of the heads of transformer models. These heads perform in the first layers preferably global averaging and in higher layers partial averaging via metastable states. The new modern Hopfield network can be integrated into deep learning architectures as layers to allow the storage of and access to raw input data, intermediate results, or learned prototypes. These Hopfield layers enable new ways of deep learning, beyond fully-connected, convolutional, or recurrent networks, and provide pooling, memory, association, and attention mechanisms. We demonstrate the broad applicability of the Hopfield layers across various domains. Hopfield layers improved state-of-the-art on three out of four considered multiple instance learning problems as well as on immune repertoire classification with several hundreds of thousands of instances. On the UCI benchmark collections of small classification tasks, where deep learning methods typically struggle, Hopfield layers yielded a new state-of-the-art when compared to different machine learning methods. Finally, Hopfield layers achieved state-of-the-art on two drug design datasets. The implementation is available at: https://github.com/ml-jku/hopfield-layers △ Less

Submitted 28 April, 2021; v1 submitted 16 July, 2020; originally announced August 2020.

Comments: 10 pages (+ appendix); 12 figures; Blog: https://ml-jku.github.io/hopfield-layers/; GitHub: https://github.com/ml-jku/hopfield-layers

Dark Matter properties through cosmic history

Authors: Stéphane Ilić, Michael Kopp, Constantinos Skordis, Daniel B. Thomas

Abstract: We perform the first test of dark matter (DM) stress-energy evolution through cosmic history, using cosmic microwave background measurements supplemented with baryon acoustic oscillation data and the Hubble Space Telescope key project data. We constrain the DM equation of state (EoS) in 8 redshift bins, and its sound speed and (shear) viscosity in 9 redshift bins, finding no convincing evidence fo… ▽ More We perform the first test of dark matter (DM) stress-energy evolution through cosmic history, using cosmic microwave background measurements supplemented with baryon acoustic oscillation data and the Hubble Space Telescope key project data. We constrain the DM equation of state (EoS) in 8 redshift bins, and its sound speed and (shear) viscosity in 9 redshift bins, finding no convincing evidence for non-$Λ$CDM values in any of the redshift bins. Despite this enlarged parameter space, the sound speed and viscosity are constrained relatively well at late times (due to the inclusion of CMB lensing), whereas the EoS is most strongly constrained around recombination. These results constrain for the first time the level of "coldness" required of DM across various cosmological epochs at both the background and perturbative levels. We show that simultaneously allowing time dependence for both the EoS and sound speed parameters shifts the posterior of the DM abundance before recombination to a higher value, while keeping the present day DM abundance similar to the $Λ$CDM value. This shifts the posterior for the present day Hubble constant compared to $Λ$CDM, suggesting that DM with time-dependent parameters is well-suited to explore possible solutions to persistent tensions within the $Λ$CDM model. We perform a detailed comparison with our previous study involving a vanishing sound speed and viscosity using the same datasets in order to explain the physical mechanism behind these shifts. △ Less

Submitted 8 September, 2021; v1 submitted 20 April, 2020; originally announced April 2020.

Comments: 20 pages, 10 figures, 5 tables; updated to match version published in PRD

Journal ref: Phys. Rev. D 104, 043520 (2021)

Investigating the use of field solvers for simulating classical systems

Authors: Andrew Eberhardt, Arka Banerjee, Michael Kopp, Tom Abel

Abstract: We explore the use of field solvers as approximations of classical Vlasov-Poisson systems. This correspondence is investigated in both electrostatic and gravitational contexts. We demonstrate the ability of field solvers to be excellent approximations of problems with cold initial condition into the non linear regime. We also investigate extensions of the Schrödinger-Poisson system that employ mul… ▽ More We explore the use of field solvers as approximations of classical Vlasov-Poisson systems. This correspondence is investigated in both electrostatic and gravitational contexts. We demonstrate the ability of field solvers to be excellent approximations of problems with cold initial condition into the non linear regime. We also investigate extensions of the Schrödinger-Poisson system that employ multiple stacked cold streams, and the von Neumann-Poisson equation as methods that can successfully reproduce the classical evolution of warm initial conditions. We then discuss how appropriate simulation parameters need to be chosen to avoid interference terms, aliasing, and wave behavior in the field solver solutions. We present a series of criteria clarifying how parameters need to be chosen in order to effectively approximate classical solutions. △ Less

Submitted 2 March, 2020; v1 submitted 14 January, 2020; originally announced January 2020.

Comments: 28 pages, 14 figures. Matches published version Phys. Rev. D

Journal ref: Phys. Rev. D 101, 043011 (2020)

Weakly nonlinear magnetic convection in a nonuniformly rotating electrically conductive medium under the action of modulation of external fields

Authors: M. I. Kopp, A. V. Tur, V. V. Yanovsky

Abstract: In this paper we studied the weakly nonlinear stage of stationary convective instability in a nonuniformly rotating layer of an electrically conductive fluid in an axial uniform magnetic field under the influence of: a) temperature modulation of the layer boundaries; b) gravitational modulation; c) modulation of the magnetic field; d) modulation of the angular velocity of rotation. As a result of… ▽ More In this paper we studied the weakly nonlinear stage of stationary convective instability in a nonuniformly rotating layer of an electrically conductive fluid in an axial uniform magnetic field under the influence of: a) temperature modulation of the layer boundaries; b) gravitational modulation; c) modulation of the magnetic field; d) modulation of the angular velocity of rotation. As a result of applying the method of perturbation theory for the small parameter of supercriticality of the stationary Rayleigh number nonlinear non-autonomous Ginzburg-Landau equations for the above types of modulation were obtaned. By utilizing the solution of the Ginzburg-Landau equation, we determined the dynamics of unsteady heat transfer for various types of modulation of external fields and for different profiles of the angular velocity of the rotation of electrically conductive fluid. △ Less

Submitted 13 November, 2019; originally announced November 2019.

Comments: 44 pages, 28 figures

Gas-filled pore in bounded particle

Authors: V. V. Yanovsky, M. I. Kopp, M. A. Ratner

Abstract: The diffusive evolution has been studied of gas-filled pore has in a bounded particle in gas media. The nonlinear equation set, describing the behaviour of gas-filled pore on bounded particle is obtained. Asymptotic modes are considered for evolution of small and large pores. Analytical solutions are obtained in asymptotic modes. The comparison is conducted of these solutions with results of numer… ▽ More The diffusive evolution has been studied of gas-filled pore has in a bounded particle in gas media. The nonlinear equation set, describing the behaviour of gas-filled pore on bounded particle is obtained. Asymptotic modes are considered for evolution of small and large pores. Analytical solutions are obtained in asymptotic modes. The comparison is conducted of these solutions with results of numerical solution of complete equation set. The characteristic regularities of gas-filled pore behavior are found at arbitrary pore position relative to matrix particle center. △ Less

Submitted 29 October, 2019; originally announced October 2019.

Comments: 30 pages, 6 figures. arXiv admin note: text overlap with arXiv:1810.10319

Rayleigh-Benard convection in a nonuniformly rotating electrically conductive medium in an external spiral magnetic field

Authors: M. I. Kopp, A. V. Tur, V. V. Yanovsky

Abstract: The research is devoted to the stability of convective flow in a nonuniformly rotating layer of an electrically conducting fluid in a spiral magnetic field. The stationary and oscillatory modes of magnetic convection are considered depending on the profile of the angular rotation velocity (Rossby number $\textrm{Ro}$) and on the profile of the external azimuthal magnetic field (magnetic Rossby num… ▽ More The research is devoted to the stability of convective flow in a nonuniformly rotating layer of an electrically conducting fluid in a spiral magnetic field. The stationary and oscillatory modes of magnetic convection are considered depending on the profile of the angular rotation velocity (Rossby number $\textrm{Ro}$) and on the profile of the external azimuthal magnetic field (magnetic Rossby number $\textrm{Rb}$). The nonlinear dynamic system of Lorentz type equations is obtained by using the Galerkin method. Numerical analysis of these equations has shown the presence of chaotic behavior of convective flows. The criteria of the occurrence of chaotic movements are found. It depends on the parameters of convection: dimensionless numbers of Rayleigh $\textrm{Ra}$, Chandrasekhar $\textrm{Q}$, Taylor $\textrm{Ta}$, and external azimuthal magnetic field with the Rossby magnetic number $\textrm{Rb}=-1$ for Rayleigh $(\textrm{Ro}=-1)$ and Kepler $(\textrm{Ro}=-3/4)$ profiles of the angular rotation velocity of the medium. △ Less

Submitted 14 May, 2019; originally announced May 2019.

Comments: 37 pages, 14 figures

Using large scale structure data and a halo model to constrain Generalised Dark Matter

Authors: Daniel B Thomas, Michael Kopp, Katarina Markovič

Abstract: Constraints on the properties of the cosmological dark matter have previously been obtained in a model-independent fashion using the Generalised Dark Matter (GDM) framework. Here we extend that work in several directions: We consider the inclusion of WiggleZ matter power spectrum data, and show that this improves the constraints on the two perturbative GDM parameters, $c^2_s$ and $c^2_\text{vis}$,… ▽ More Constraints on the properties of the cosmological dark matter have previously been obtained in a model-independent fashion using the Generalised Dark Matter (GDM) framework. Here we extend that work in several directions: We consider the inclusion of WiggleZ matter power spectrum data, and show that this improves the constraints on the two perturbative GDM parameters, $c^2_s$ and $c^2_\text{vis}$, by a factor of 3, for a conservative choice of wavenumber range. A less conservative choice can yield an improvement of up to an order of magnitude compared to previous constraints. In order to examine the robustness of this result we develop a GDM halo model to explore how non-linear structure formation could proceed in this framework, since currently GDM has only been defined perturbatively and only linear theory has been used when generating constraints. We then examine how the halo model affects the constraints obtained from the matter power spectrum data. The less-conservative wavenumber range shows a significant difference between linear and non-linear modelling, with the latter favouring GDM parameters inconsistent with $Λ$CDM, underlining the importance of careful non-linear modelling when using this data. We also use this halo model to establish the robustness of previously obtained constraints, particularly those that involve weak gravitational lensing of the cosmic microwave background. Additionally, we show how the inclusion of neutrino mass as a free parameter affects previous constraints on the GDM parameters. △ Less

Submitted 4 May, 2020; v1 submitted 7 May, 2019; originally announced May 2019.

Comments: 27 pages, 10 figures. Updated to match published version: a few minor clarifications on the choices in the halo model construction and relation to WDM and an additional plot showing the mass function

Evolution of gas-filled pore in bounded particles

Authors: V. V. Yanovsky, M. I. Kopp, M. A. Ratner

Abstract: In the present work, evolution of gas-filled pore inside spherical nanoshells is considered. On the supposition that diffusion fluxes are quasistationary, the nonlinear equation system is obtained analytically, that describes completely the behaviour of gas-filled pore and matrix shell. Two limiting cases are considered: the case when the pore is small as compared to the matrix shell and the case… ▽ More In the present work, evolution of gas-filled pore inside spherical nanoshells is considered. On the supposition that diffusion fluxes are quasistationary, the nonlinear equation system is obtained analytically, that describes completely the behaviour of gas-filled pore and matrix shell. Two limiting cases are considered: the case when the pore is small as compared to the matrix shell and the case of the pore close to the matrix shell boundary. The characteristic regularities of pore behaviour are established. △ Less

Submitted 10 October, 2018; originally announced October 2018.

Comments: 26 pages, 9 figures. arXiv admin note: substantial text overlap with arXiv:1809.06565

Dark energy after GW170817, revisited

Authors: Edmund J. Copeland, Michael Kopp, Antonio Padilla, Paul M. Saffin, Constantinos Skordis

Abstract: We revisit the status of scalar-tensor theories with applications to dark energy in the aftermath of the gravitational wave signal GW170817 and its optical counterpart GRB170817A. At the level of the cosmological background, we identify a class of theories, previously declared unviable in this context, whose anomalous gravitational wave speed is proportional to the scalar equation of motion. As lo… ▽ More We revisit the status of scalar-tensor theories with applications to dark energy in the aftermath of the gravitational wave signal GW170817 and its optical counterpart GRB170817A. At the level of the cosmological background, we identify a class of theories, previously declared unviable in this context, whose anomalous gravitational wave speed is proportional to the scalar equation of motion. As long as the scalar field is assumed not to couple directly to matter, this raises the possibility of compatibility with the gravitational wave data, for any cosmological sources, thanks to the scalar dynamics. This newly "rescued" class of theories includes examples of generalised quintic galileons from Horndeski theories. Despite the promise of this leading order result, we show that the loophole ultimately fails when we include the effect of large scale inhomogeneities. △ Less

Submitted 2 November, 2018; v1 submitted 18 October, 2018; originally announced October 2018.

Comments: Updated with corrections to the gravitational wave propagation coming from higher order terms in the presence of large scale inhomogeneities. These close off any remaining loopholes. References added

Journal ref: Phys. Rev. Lett. 122, 061301 (2019)

Evolution of vacancy pores in bounded particles

Authors: V. V. Yanovsky, M. I. Kopp, M. A. Ratner

Abstract: In the present work, the behavior of vacancy pore inside of spherical particle is investigated. On the assumption of quasistationarity of diffusion fluxes, the nonlinear equation set was obtained analytically, that describes completely pore behavior inside of spherical particle. Limiting cases of small and large pores are considered. The comparison of numerical results with asymptotic behavior of… ▽ More In the present work, the behavior of vacancy pore inside of spherical particle is investigated. On the assumption of quasistationarity of diffusion fluxes, the nonlinear equation set was obtained analytically, that describes completely pore behavior inside of spherical particle. Limiting cases of small and large pores are considered. The comparison of numerical results with asymptotic behavior of considered limiting cases of small and large pores is discussed. △ Less

Submitted 18 September, 2018; originally announced September 2018.

Comments: 25 pages, 10 figures

Nonlinear dynamo in obliquely rotating stratified electroconductive fluid in an uniformly magnetic field

Authors: M. I. Kopp, K. N. Kulik, A. V. Tur, V. V. Yanovsky

Abstract: We study a new type of large-scale instability, which arises in obliquely rotating stratified electroconductive fluid with an external uniform magnetic field and a small-scale external force having zero helicity. This force gives rise to small-scale oscillations of the velocity with a small Reynolds number. Using the method of multi-scale asymptotic expansions there are obtained nonlinear equation… ▽ More We study a new type of large-scale instability, which arises in obliquely rotating stratified electroconductive fluid with an external uniform magnetic field and a small-scale external force having zero helicity. This force gives rise to small-scale oscillations of the velocity with a small Reynolds number. Using the method of multi-scale asymptotic expansions there are obtained nonlinear equations for vortex and magnetic perturbations in the third order in Reynolds number. Studied is the linear stage of magneto-vortex dynamo caused by instabilities of $α$-effect type. Stationary solutions for the equations of nonlinear magneto-vortex dynamo are found by numerical methods in the form of localized chaotic structures. △ Less

Submitted 3 July, 2018; originally announced July 2018.

Comments: 38 pages, 24 figures