-
End-to-end localized deep learning for Cryo-ET
Authors:
Vinith Kishore,
Valentin Debarnot,
Ricardo D. Righetto,
AmirEhsan Khorashadizadeh,
Benjamin D. Engel,
Ivan Dokmanić
Abstract:
Cryo-electron tomography (cryo-ET) enables 3D visualization of cellular environments. Accurate reconstruction of high-resolution volumes is complicated by the very low signal-to-noise ratio and a restricted range of sample tilts, creating a missing wedge of Fourier information. Recent self-supervised deep learning approaches, which post-process initial reconstructions done by filtered backprojecti…
▽ More
Cryo-electron tomography (cryo-ET) enables 3D visualization of cellular environments. Accurate reconstruction of high-resolution volumes is complicated by the very low signal-to-noise ratio and a restricted range of sample tilts, creating a missing wedge of Fourier information. Recent self-supervised deep learning approaches, which post-process initial reconstructions done by filtered backprojection (FBP), have significantly improved reconstruction quality, but they are computationally expensive, demand large memory, and require retraining for each new dataset. End-to-end supervised learning is an appealing alternative but is impeded by the lack of ground truth and the large memory demands of high-resolution volumetric data. Training on synthetic data often leads to overfitting and poor generalization to real data, and, to date, no general end-to-end deep learning reconstructors exist for cryo-ET. In this work, we introduce CryoLithe, a local, memory-efficient reconstruction network that directly estimates the volume from an aligned tilt-series, overcoming the suboptimal FBP. We demonstrate that leveraging transform-domain locality makes our network robust to distribution shifts, enabling effective supervised training and giving excellent results on real data -- without retraining or fine-tuning.
△ Less
Submitted 9 May, 2025; v1 submitted 25 January, 2025;
originally announced January 2025.
-
The Structure of Emulations in Classical Spin Models: Modularity and Universality
Authors:
Tobias Reinhart,
Benjamin Engel,
Gemma De les Coves
Abstract:
The theory of spin models intersects with condensed matter physics, complex systems, graph theory, combinatorial optimization, computational complexity and neural networks. Many ensuing applications rely on the fact that complicated spin models can be transformed to simpler ones. What is the structure of such transformations? Here, we provide a framework to study and construct emulations between s…
▽ More
The theory of spin models intersects with condensed matter physics, complex systems, graph theory, combinatorial optimization, computational complexity and neural networks. Many ensuing applications rely on the fact that complicated spin models can be transformed to simpler ones. What is the structure of such transformations? Here, we provide a framework to study and construct emulations between spin models. A spin model is a set of spin systems, and emulations are efficiently computable simulations with arbitrary energy cut-off, where a source spin system simulates a target system if, below the cut-off, the target Hamiltonian is encoded in the source Hamiltonian. We prove that emulations preserve important properties, as they induce reductions between computational problems such as computing ground states, approximating partition functions and approximate sampling from Boltzmann distributions. Emulations are modular (they can be added, scaled and composed), and allow for universality, i.e. certain spin models have maximal reach. We prove that a spin model is universal if and only if it is scalable, closed and functional complete. Because the characterization is constructive, it provides a step-by-step guide to construct emulations. We prove that the 2d Ising model with fields is universal, for which we also provide two new crossing gadgets. Finally, we show that simulations can be computed by linear programs. While some ideas of this work are contained in [1], we provide new definitions and theorems. This framework provides a toolbox for applications involving emulations of spin models.
△ Less
Submitted 1 August, 2024; v1 submitted 18 July, 2024;
originally announced July 2024.
-
A Forecast Based Load Management Approach For Commercial Buildings -- Comparing LSTM And Standardized Load Profile Techniques
Authors:
Thomas Steens,
Jan-Simon Telle,
Benedikt Hanke,
Karsten von Maydell,
Carsten Agert,
Gian-Luca di Modica,
Bernd Engel,
Matthias Grottke
Abstract:
Load-forecasting problems have already been widely addressed with different approaches, granularities and objectives. Recent studies focus not only on deep learning methods but also on forecasting loads on single building level. This study aims to research problems and possibilities arising by using different load forecasting techniques to manage loads. For that the behaviour of two neural network…
▽ More
Load-forecasting problems have already been widely addressed with different approaches, granularities and objectives. Recent studies focus not only on deep learning methods but also on forecasting loads on single building level. This study aims to research problems and possibilities arising by using different load forecasting techniques to manage loads. For that the behaviour of two neural networks, Long Short-Term Memory and Feed Forward Neural Network and two statistical methods, standardized load profiles and personalized standardized load profiles are analysed and assessed by using a sliding-window forecast approach. The results show that machine learning algorithms have the benefit of being able to adapt to new patterns, whereas the personalized standardized load profile performs similar to the tested deep learning algorithms on the metrics. As a case study for evaluating the support of load-forecasting for applications in Energy management systems, the integration of charging stations into an existing building is simulated by using load forecasts to schedule the charging procedures. It shows that such a system can lead to significantly lower load peaks, exceeding a defined grid limit, and to a lower number of overloads compared to uncontrolled charging.
△ Less
Submitted 14 July, 2020;
originally announced July 2020.
-
GivEn -- Shape Optimization for Gas Turbines in Volatile Energy Networks
Authors:
Jan Backhaus,
Matthias Bolten,
Onur Tanil Doganay,
Matthias Ehrhardt,
Benedikt Engel,
Christian Frey,
Hanno Gottschalk,
Michael Günther,
Camilla Hahn,
Jens Jäschke,
Peter Jaksch,
Kathrin Klamroth,
Alexander Liefke,
Daniel Luft,
Lucas Mäde,
Vincent Marciniak,
Marco Reese,
Johanna Schultes,
Volker Schulz,
Sebastian Schmitz,
Johannes Steiner,
Michael Stiglmayr
Abstract:
This paper describes the project GivEn that develops a novel multicriteria optimization process for gas turbine blades and vanes using modern "adjoint" shape optimization algorithms. Given the many start and shut-down processes of gas power plants in volatile energy grids, besides optimizing gas turbine geometries for efficiency, the durability understood as minimization of the probability of fail…
▽ More
This paper describes the project GivEn that develops a novel multicriteria optimization process for gas turbine blades and vanes using modern "adjoint" shape optimization algorithms. Given the many start and shut-down processes of gas power plants in volatile energy grids, besides optimizing gas turbine geometries for efficiency, the durability understood as minimization of the probability of failure is a design objective of increasing importance. We also describe the underlying coupling structure of the multiphysical simulations and use modern, gradient based multicriteria optimization procedures to enhance the exploration of Pareto-optimal solutions.
△ Less
Submitted 20 February, 2020;
originally announced February 2020.
-
Artificial Intelligence for Digital Agriculture at Scale: Techniques, Policies, and Challenges
Authors:
Somali Chaterji,
Nathan DeLay,
John Evans,
Nathan Mosier,
Bernard Engel,
Dennis Buckmaster,
Ranveer Chandra
Abstract:
Digital agriculture has the promise to transform agricultural throughput. It can do this by applying data science and engineering for mapping input factors to crop throughput, while bounding the available resources. In addition, as the data volumes and varieties increase with the increase in sensor deployment in agricultural fields, data engineering techniques will also be instrumental in collecti…
▽ More
Digital agriculture has the promise to transform agricultural throughput. It can do this by applying data science and engineering for mapping input factors to crop throughput, while bounding the available resources. In addition, as the data volumes and varieties increase with the increase in sensor deployment in agricultural fields, data engineering techniques will also be instrumental in collection of distributed data as well as distributed processing of the data. These have to be done such that the latency requirements of the end users and applications are satisfied. Understanding how farm technology and big data can improve farm productivity can significantly increase the world's food production by 2050 in the face of constrained arable land and with the water levels receding. While much has been written about digital agriculture's potential, little is known about the economic costs and benefits of these emergent systems. In particular, the on-farm decision making processes, both in terms of adoption and optimal implementation, have not been adequately addressed. For example, if some algorithm needs data from multiple data owners to be pooled together, that raises the question of data ownership. This paper is the first one to bring together the important questions that will guide the end-to-end pipeline for the evolution of a new generation of digital agricultural solutions, driving the next revolution in agriculture and sustainability under one umbrella.
△ Less
Submitted 21 January, 2020;
originally announced January 2020.
-
Effect of local anisotropy on fatigue crack initiation in a coarse grained nickel-base superalloy
Authors:
Benedikt Engel,
Tilmann Beck,
Nadine Moch,
Hanno Gottschalk,
Sebastian Schmitz
Abstract:
In the present work, theoretical approaches, based on grain orientation dependent Young's modulus and Schmid factor are used to describe the influence of local grain orientation on crack initiation behaviour of the coarse grained nickel base superalloy René80. Especially for strongly anisotropic crystal structures with large grain size, such as the investigated material, the local elastic properti…
▽ More
In the present work, theoretical approaches, based on grain orientation dependent Young's modulus and Schmid factor are used to describe the influence of local grain orientation on crack initiation behaviour of the coarse grained nickel base superalloy René80. Especially for strongly anisotropic crystal structures with large grain size, such as the investigated material, the local elastic properties must be taken into account for assessment of fatigue crack initiation. With an extension of Schmid's law, the resulting shear stress amplitude, which triggers local cyclic plastic deformation, can be calculated depending on local Young's modulus and Schmid factor. A Monte Carlo simulation with 100,000 samples shows how random grain orientation affects these parameters. Furthermore, the product of Young's modulus and Schmid factor (called $E\cdot m$) is used as a parameter to determine how grain orientation influences resulting shear stress amplitude for given total strain amplitude. In addition to the theoretical work using that approach, this model is also validated using isothermal LCF experiments by determining local grain orientation influence on the crack initiation site using SEM-EBSD analyses.
△ Less
Submitted 6 June, 2018;
originally announced June 2018.
-
Marker-based estimation of heritability in immortal populations
Authors:
Willem Kruijer,
Martin Boer,
Marcos Malosetti,
Padraic J. Flood,
Bas Engel,
Rik Kooke,
Joost Keurentjes,
Fred van Eeuwijk
Abstract:
Heritability is a central parameter in quantitative genetics, both from an evolutionary and a breeding perspective. For plant traits heritability is traditionally estimated by comparing within and between genotype variability. This approach estimates broad-sense heritability, and does not account for different genetic relatedness. With the availability of high-density markers there is growing inte…
▽ More
Heritability is a central parameter in quantitative genetics, both from an evolutionary and a breeding perspective. For plant traits heritability is traditionally estimated by comparing within and between genotype variability. This approach estimates broad-sense heritability, and does not account for different genetic relatedness. With the availability of high-density markers there is growing interest in marker based estimates of narrow-sense heritability, using mixed models in which genetic relatedness is estimated from genetic markers. Such estimates have received much attention in human genetics but are rarely reported for plant traits. A major obstacle is that current methodology and software assume a single phenotypic value per genotype, hence requiring genotypic means. An alternative that we propose here, is to use mixed models at individual plant or plot level. Using statistical arguments, simulations and real data we investigate the feasibility of both approaches, and how these affect genomic prediction with G-BLUP and genome-wide association studies. Heritability estimates obtained from genotypic means had very large standard errors and were sometimes biologically unrealistic. Mixed models at individual plant or plot level produced more realistic estimates, and for simulated traits standard errors were up to 13 times smaller. Genomic prediction was also improved by using these mixed models, with up to a 49% increase in accuracy. For GWAS on simulated traits, the use of individual plant data gave almost no increase in power. The new methodology is applicable to any complex trait where multiple replicates of individual genotypes can be scored. This includes important agronomic crops, as well as bacteria and fungi.
△ Less
Submitted 16 February, 2015; v1 submitted 21 December, 2014;
originally announced December 2014.
-
Log-concavity of the overpartition function
Authors:
Benjamin Engel
Abstract:
We prove that the overpartition function is log-concave for all n>1. The proof is based on Sills Rademacher type series for the overpartition function and inspired by Desalvo and Pak's proof for the partition function.
We prove that the overpartition function is log-concave for all n>1. The proof is based on Sills Rademacher type series for the overpartition function and inspired by Desalvo and Pak's proof for the partition function.
△ Less
Submitted 22 December, 2014; v1 submitted 15 December, 2014;
originally announced December 2014.
-
Chiefly Symmetric: Results on the Scalability of Probabilistic Model Checking for Operating-System Code
Authors:
Christel Baier,
Marcus Daum,
Benjamin Engel,
Hermann Härtig,
Joachim Klein,
Sascha Klüppelholz,
Steffen Märcker,
Hendrik Tews,
Marcus Völp
Abstract:
Reliability in terms of functional properties from the safety-liveness spectrum is an indispensable requirement of low-level operating-system (OS) code. However, with evermore complex and thus less predictable hardware, quantitative and probabilistic guarantees become more and more important. Probabilistic model checking is one technique to automatically obtain these guarantees. First experiences…
▽ More
Reliability in terms of functional properties from the safety-liveness spectrum is an indispensable requirement of low-level operating-system (OS) code. However, with evermore complex and thus less predictable hardware, quantitative and probabilistic guarantees become more and more important. Probabilistic model checking is one technique to automatically obtain these guarantees. First experiences with the automated quantitative analysis of low-level operating-system code confirm the expectation that the naive probabilistic model checking approach rapidly reaches its limits when increasing the numbers of processes. This paper reports on our work-in-progress to tackle the state explosion problem for low-level OS-code caused by the exponential blow-up of the model size when the number of processes grows. We studied the symmetry reduction approach and carried out our experiments with a simple test-and-test-and-set lock case study as a representative example for a wide range of protocols with natural inter-process dependencies and long-run properties. We quickly see a state-space explosion for scenarios where inter-process dependencies are insignificant. However, once inter-process dependencies dominate the picture models with hundred and more processes can be constructed and analysed.
△ Less
Submitted 26 November, 2012;
originally announced November 2012.
-
Role of interactions in ferrofluid thermal ratchets
Authors:
Volker Becker Andreas Engel
Abstract:
Orientational fluctuations of colloidal particles with magnetic moments may be rectified with the help of external magnetic fields with suitably chosen time dependence. As a result a noise-driven rotation of particles occurs giving rise to a macroscopic torque per volume of the carrier liquid. We investigate the influence of mutual interactions between the particles on this ratchet effect by stu…
▽ More
Orientational fluctuations of colloidal particles with magnetic moments may be rectified with the help of external magnetic fields with suitably chosen time dependence. As a result a noise-driven rotation of particles occurs giving rise to a macroscopic torque per volume of the carrier liquid. We investigate the influence of mutual interactions between the particles on this ratchet effect by studying a model system with mean-field interactions. The stochastic dynamics may be described by a nonlinear Fokker-Planck equation for the collective orientation of the particles which we solve approximately by using the effective field method. We determine an interval for the ratio between coupling strength and noise intensity for which a self-sustained rectification of fluctuations becomes possible. The ratchet effect then operates under conditions for which it were impossible in the absence of interactions.
△ Less
Submitted 21 September, 2006;
originally announced September 2006.
