Showing 1–14 of 14 results for author: Burger, M

A Tunable Despeckling Neural Network Stabilized via Diffusion Equation

Authors: Yi Ran, Zhichang Guo, Jia Li, Yao Li, Martin Burger, Boying Wu

Abstract: The removal of multiplicative Gamma noise is a critical research area in the application of synthetic aperture radar (SAR) imaging, where neural networks serve as a potent tool. However, real-world data often diverges from theoretical models, exhibiting various disturbances, which makes the neural network less effective. Adversarial attacks can be used as a criterion for judging the adaptability o… ▽ More The removal of multiplicative Gamma noise is a critical research area in the application of synthetic aperture radar (SAR) imaging, where neural networks serve as a potent tool. However, real-world data often diverges from theoretical models, exhibiting various disturbances, which makes the neural network less effective. Adversarial attacks can be used as a criterion for judging the adaptability of neural networks to real data, since adversarial attacks can find the most extreme perturbations that make neural networks ineffective. In this work, the diffusion equation is designed as a regularization block to provide sufficient regularity to the whole neural network, due to its spontaneous dissipative nature. We propose a tunable, regularized neural network framework that unrolls a shallow denoising neural network block and a diffusion regularity block into a single network for end-to-end training. The linear heat equation, known for its inherent smoothness and low-pass filtering properties, is adopted as the diffusion regularization block. In our model, a single time step hyperparameter governs the smoothness of the outputs and can be adjusted dynamically, significantly enhancing flexibility. The stability and convergence of our model are theoretically proven. Experimental results demonstrate that the proposed model effectively eliminates high-frequency oscillations induced by adversarial attacks. Finally, the proposed model is benchmarked against several state-of-the-art denoising methods on simulated images, adversarial samples, and real SAR images, achieving superior performance in both quantitative and visual evaluations. △ Less

Submitted 23 December, 2024; v1 submitted 24 November, 2024; originally announced November 2024.

Convergent Data-driven Regularizations for CT Reconstruction

Authors: Samira Kabri, Alexander Auras, Danilo Riccio, Hartmut Bauermeister, Martin Benning, Michael Moeller, Martin Burger

Abstract: The reconstruction of images from their corresponding noisy Radon transform is a typical example of an ill-posed linear inverse problem as arising in the application of computerized tomography (CT). As the (naive) solution does not depend on the measured data continuously, regularization is needed to re-establish a continuous dependence. In this work, we investigate simple, but yet still provably… ▽ More The reconstruction of images from their corresponding noisy Radon transform is a typical example of an ill-posed linear inverse problem as arising in the application of computerized tomography (CT). As the (naive) solution does not depend on the measured data continuously, regularization is needed to re-establish a continuous dependence. In this work, we investigate simple, but yet still provably convergent approaches to learning linear regularization methods from data. More specifically, we analyze two approaches: One generic linear regularization that learns how to manipulate the singular values of the linear operator in an extension of our previous work, and one tailored approach in the Fourier domain that is specific to CT-reconstruction. We prove that such approaches become convergent regularization methods as well as the fact that the reconstructions they provide are typically much smoother than the training data they were trained on. Finally, we compare the spectral as well as the Fourier-based approaches for CT-reconstruction numerically, discuss their advantages and disadvantages and investigate the effect of discretization errors at different resolutions. △ Less

Submitted 15 December, 2023; v1 submitted 14 December, 2022; originally announced December 2022.

Learning convex regularizers satisfying the variational source condition for inverse problems

Authors: Subhadip Mukherjee, Carola-Bibiane Schönlieb, Martin Burger

Abstract: Variational regularization has remained one of the most successful approaches for reconstruction in imaging inverse problems for several decades. With the emergence and astonishing success of deep learning in recent years, a considerable amount of research has gone into data-driven modeling of the regularizer in the variational setting. Our work extends a recently proposed method, referred to as a… ▽ More Variational regularization has remained one of the most successful approaches for reconstruction in imaging inverse problems for several decades. With the emergence and astonishing success of deep learning in recent years, a considerable amount of research has gone into data-driven modeling of the regularizer in the variational setting. Our work extends a recently proposed method, referred to as adversarial convex regularization (ACR), that seeks to learn data-driven convex regularizers via adversarial training in an attempt to combine the power of data with the classical convex regularization theory. Specifically, we leverage the variational source condition (SC) during training to enforce that the ground-truth images minimize the variational loss corresponding to the learned convex regularizer. This is achieved by adding an appropriate penalty term to the ACR training objective. The resulting regularizer (abbreviated as ACR-SC) performs on par with the ACR, but unlike ACR, comes with a quantitative convergence rate estimate. △ Less

Submitted 24 October, 2021; originally announced October 2021.

Comments: Accepted to the NeurIPS-2021 Workshop on Deep Learning and Inverse Problems

Region-of-Interest Prioritised Sampling for Constrained Autonomous Exploration Systems

Authors: Protim Bhattacharjee, Martin Burger, Anko Boerner, Veniamin I. Morgenshtern

Abstract: Goal oriented autonomous operation of space rovers has been known to increase scientific output of a mission. In this work we present an algorithm, called the RoI Prioritised Sampling (RPS), that prioritises Region-of-Interests (RoIs) in an exploration scenario in order to utilise the limited resources of the imaging instrument on the rover effectively. This prioritisation is based on an estimator… ▽ More Goal oriented autonomous operation of space rovers has been known to increase scientific output of a mission. In this work we present an algorithm, called the RoI Prioritised Sampling (RPS), that prioritises Region-of-Interests (RoIs) in an exploration scenario in order to utilise the limited resources of the imaging instrument on the rover effectively. This prioritisation is based on an estimator that evaluates the change in information content at consecutive spatial scales of the RoIs without calculating the finer scale reconstruction. The estimator, called the Refinement Indicator (RI), is motivated and derived. Multi-scale acquisition approaches, based on classical and multilevel compressed sensing, with respect to the single pixel camera architecture are discussed. The performance of the algorithm is verified on remote sensing images and compared with the state-of-the-art multi-resolution reconstruction algorithms. At the considered sub-sampling rates the RPS is shown to better utilise the system resources for reconstructing the RoIs. △ Less

Submitted 19 February, 2022; v1 submitted 15 July, 2021; originally announced July 2021.

Journal ref: IEEE Trans. Comput. Imag. 8 (2002) 302-316

Adaptive Superresolution in Deconvolution of Sparse Peaks

Authors: Alexandra Koulouri, Pia Heins, Martin Burger

Abstract: The aim of this paper is to investigate superresolution in deconvolution driven by sparsity priors. The observed signal is a convolution of an original signal with a continuous kernel.With the prior knowledge that the original signal can be considered as a sparse combination of Dirac delta peaks, we seek to estimate the positions and amplitudes of these peaks by solving a finite dimensional convex… ▽ More The aim of this paper is to investigate superresolution in deconvolution driven by sparsity priors. The observed signal is a convolution of an original signal with a continuous kernel.With the prior knowledge that the original signal can be considered as a sparse combination of Dirac delta peaks, we seek to estimate the positions and amplitudes of these peaks by solving a finite dimensional convex problem on a computational grid. Because, the support of the original signal may or may not be on this grid, by studying the discrete deconvolution of sparse peaks using L1-norm sparsity prior, we confirm recent observations that canonically the discrete reconstructions will result in multiple peaks at grid points adjacent to the location of the true peak. Owning to the complexity of this problem, we analyse carefully the de-convolution of single peaks on a grid and gain a strong insight about the dependence of the reconstructed magnitudes on the exact peak location. This in turn allows us to infer further information on recovering the location of the exact peaks i.e. to perform super-resolution. We analyze in detail the possible cases that can appear and based on our theoretical findings, we propose an self-driven adaptive grid approach that allows to perform superresolution in one-dimensional and multi-dimensional spaces. With the view that the current study can provide a further step in the development of more robust algorithms for the detection of single molecules in fluorescence microscopy or identification of characteristic frequencies in spectral analysis, we demonstrate how the proposed approach can recover sparse signals using simulated clusters of point sources (peaks) of low-resolution in one and two-dimensional spaces. △ Less

Submitted 10 July, 2020; originally announced July 2020.

Comments: It can help to improve super-resolution algorithms that use sparsity constraints

Sequentially optimized projections in X-ray imaging

Authors: Martin Burger, Andreas Hauptmann, Tapio Helin, Nuutti Hyvönen, Juha-Pekka Puska

Abstract: This work applies Bayesian experimental design to selecting optimal projection geometries in (discretized) parallel beam X-ray tomography assuming the prior and the additive noise are Gaussian. The introduced greedy exhaustive optimization algorithm proceeds sequentially, with the posterior distribution corresponding to the previous projections serving as the prior for determining the design param… ▽ More This work applies Bayesian experimental design to selecting optimal projection geometries in (discretized) parallel beam X-ray tomography assuming the prior and the additive noise are Gaussian. The introduced greedy exhaustive optimization algorithm proceeds sequentially, with the posterior distribution corresponding to the previous projections serving as the prior for determining the design parameters, i.e. the imaging angle and the lateral position of the source-receiver pair, for the next one. The algorithm allows redefining the region of interest after each projection as well as adapting parameters in the (original) prior to the measured data. Both A and D-optimality are considered, with emphasis on efficient evaluation of the corresponding objective functions. Two-dimensional numerical experiments demonstrate the functionality of the approach. △ Less

Submitted 22 June, 2020; originally announced June 2020.

Comments: 23 pages, 8 figures

MSC Class: 62K05; 65F22

Detection of cellular micromotion by advanced signal processing

Authors: Stephan Rinner, Alberto Trentino, Heike Url, M. Florian G. Burger, Julian von Lautz, Bernhard Wolfrum, Friedemann Reinhard

Abstract: Cellular micromotion - a tiny movement of cell membranes on the nanometer-micrometer scale - has been proposed as a pathway for inter-cellular signal transduction and as a label-free proxy signal to neural activity. Here we harness several recent approaches of signal processing to detect such micromotion in video recordings of unlabeled cells. Our survey includes spectral filtering of the video si… ▽ More Cellular micromotion - a tiny movement of cell membranes on the nanometer-micrometer scale - has been proposed as a pathway for inter-cellular signal transduction and as a label-free proxy signal to neural activity. Here we harness several recent approaches of signal processing to detect such micromotion in video recordings of unlabeled cells. Our survey includes spectral filtering of the video signal, matched filtering, as well as 1D and 3D convolutional neural networks acting on pixel-wise time-domain data and a whole recording respectively. △ Less

Submitted 23 June, 2021; v1 submitted 12 May, 2020; originally announced May 2020.

Journal ref: Scientific Reports 10, 20078 (2020)

Broadband Multizone Sound Rendering by Jointly Optimizing the Sound Pressure and Particle Velocity

Authors: Michael Buerger, Christian Hofmann, Walter Kellermann

Abstract: In this paper, a recently proposed approach to multizone sound field synthesis, referred to as Joint Pressure and Velocity Matching (JPVM), is investigated analytically using a spherical harmonics representation of the sound field. The approach is motivated by the Kirchhoff-Helmholtz integral equation and aims at controlling the sound field inside the local listening zones by evoking the sound pre… ▽ More In this paper, a recently proposed approach to multizone sound field synthesis, referred to as Joint Pressure and Velocity Matching (JPVM), is investigated analytically using a spherical harmonics representation of the sound field. The approach is motivated by the Kirchhoff-Helmholtz integral equation and aims at controlling the sound field inside the local listening zones by evoking the sound pressure and particle velocity on surrounding contours. Based on the findings of the modal analysis, an improved version of JPVM is proposed which provides both better performance and lower complexity. In particular, it is shown analytically that the optimization of the tangential component of the particle velocity vector, as is done in the original JPVM approach, is very susceptible to errors and thus not pursued anymore. The analysis furthermore provides fundamental insights as to how the spherical harmonics used to describe the 3D variant sound field translate into 2D basis functions as observed on the contours surrounding the zones. By means of simulations, it is verified that discarding the tangential component of the particle velocity vector ultimately leads to an improved performance. Finally, the impact of sensor noise on the reproduction performance is assessed. △ Less

Submitted 8 November, 2017; v1 submitted 21 September, 2017; originally announced September 2017.

An internal model approach to (optimal) frequency regulation in power grids with time-varying voltages

Authors: Sebastian Trip, Mathias Bürger, Claudio De Persis

Abstract: This paper studies the problem of frequency regulation in power grids under unknown and possible time-varying load changes, while minimizing the generation costs. We formulate this problem as an output agreement problem for distribution networks and address it using incremental passivity and distributed internal-model-based controllers. Incremental passivity enables a systematic approach to study… ▽ More This paper studies the problem of frequency regulation in power grids under unknown and possible time-varying load changes, while minimizing the generation costs. We formulate this problem as an output agreement problem for distribution networks and address it using incremental passivity and distributed internal-model-based controllers. Incremental passivity enables a systematic approach to study convergence to the steady state with zero frequency deviation and to design the controller in the presence of time-varying voltages, whereas the internal-model principle is applied to tackle the uncertain nature of the loads. △ Less

Submitted 22 September, 2015; v1 submitted 27 March, 2014; originally announced March 2014.

Comments: 16 pages. Abridged version appeared in the Proceedings of the 21st International Symposium on Mathematical Theory of Networks and Systems, MTNS 2014, Groningen, the Netherlands. Submitted in December 2013

Optimal pricing control in distribution networks with time-varying supply and demand

Authors: Mathias Bürger, Claudio De Persis, Frank Allgöwer

Abstract: This paper studies the problem of optimal flow control in dynamic inventory systems. A dynamic optimal distribution problem, including time-varying supply and demand, capacity constraints on the transportation lines, and convex flow cost functions of Legendre-type, is formalized and solved. The time-varying optimal flow is characterized in terms of the time-varying dual variables of a correspondin… ▽ More This paper studies the problem of optimal flow control in dynamic inventory systems. A dynamic optimal distribution problem, including time-varying supply and demand, capacity constraints on the transportation lines, and convex flow cost functions of Legendre-type, is formalized and solved. The time-varying optimal flow is characterized in terms of the time-varying dual variables of a corresponding network optimization problem. A dynamic feedback controller is proposed that regulates the flows asymptotically to the optimal flows and achieves in addition a balancing of all storage levels. △ Less

Submitted 27 March, 2014; originally announced March 2014.

Comments: Submitted to 21st International Symposium on Mathematical Theory of Networks and Systems (MTNS) in December 2013

Dynamic coupling design for nonlinear output agreement and time-varying flow control

Authors: Mathias Bürger, Claudio De Persis

Abstract: This paper studies the problem of output agreement in networks of nonlinear dynamical systems under time-varying disturbances, using dynamic diffusive couplings. Necessary conditions are derived for general networks of nonlinear systems, and these conditions are explicitly interpreted as conditions relating the node dynamics and the network topology. For the class of incrementally passive systems,… ▽ More This paper studies the problem of output agreement in networks of nonlinear dynamical systems under time-varying disturbances, using dynamic diffusive couplings. Necessary conditions are derived for general networks of nonlinear systems, and these conditions are explicitly interpreted as conditions relating the node dynamics and the network topology. For the class of incrementally passive systems, necessary and sufficient conditions for output agreement are derived. The approach proposed in the paper lends itself to solve flow control problems in distribution networks. As a first case study, the internal model approach is used for designing a controller that achieves an optimal routing and inventory balancing in a dynamic transportation network with storage and time-varying supply and demand. It is in particular shown that the time-varying optimal routing problem can be solved by applying an internal model controller to the dual variables of a certain convex network optimization problem. As a second case study, we show that droop-controllers in microgrids have also an interpretation as internal model controllers. △ Less

Submitted 29 November, 2013; originally announced November 2013.

Comments: submitted to Automatica

A Polyhedral Approximation Framework for Convex and Robust Distributed Optimization

Authors: Mathias Bürger, Giuseppe Notarstefano, Frank Allgöwer

Abstract: In this paper we consider a general problem set-up for a wide class of convex and robust distributed optimization problems in peer-to-peer networks. In this set-up convex constraint sets are distributed to the network processors who have to compute the optimizer of a linear cost function subject to the constraints. We propose a novel fully distributed algorithm, named cutting-plane consensus, to s… ▽ More In this paper we consider a general problem set-up for a wide class of convex and robust distributed optimization problems in peer-to-peer networks. In this set-up convex constraint sets are distributed to the network processors who have to compute the optimizer of a linear cost function subject to the constraints. We propose a novel fully distributed algorithm, named cutting-plane consensus, to solve the problem, based on an outer polyhedral approximation of the constraint sets. Processors running the algorithm compute and exchange linear approximations of their locally feasible sets. Independently of the number of processors in the network, each processor stores only a small number of linear constraints, making the algorithm scalable to large networks. The cutting-plane consensus algorithm is presented and analyzed for the general framework. Specifically, we prove that all processors running the algorithm agree on an optimizer of the global problem, and that the algorithm is tolerant to node and link failures as long as network connectivity is preserved. Then, the cutting plane consensus algorithm is specified to three different classes of distributed optimization problems, namely (i) inequality constrained problems, (ii) robust optimization problems, and (iii) almost separable optimization problems with separable objective functions and coupling constraints. For each one of these problem classes we solve a concrete problem that can be expressed in that framework and present computational results. That is, we show how to solve: position estimation in wireless sensor networks, a distributed robust linear program and, a distributed microgrid control problem. △ Less

Submitted 25 March, 2013; originally announced March 2013.

Comments: submitted to IEEE Transactions on Automatic Control

Internal models for nonlinear output agreement and optimal flow control

Authors: Mathias Burger, Claudio De Persis

Abstract: This paper studies the problem of output agreement in networks of nonlinear dynamical systems under time-varying disturbances. Necessary and sufficient conditions for output agreement are derived for the class of incrementally passive systems. Following this, it is shown that the optimal distribution problem in dynamic inventory systems with time-varying supply and demand can be cast as a special… ▽ More This paper studies the problem of output agreement in networks of nonlinear dynamical systems under time-varying disturbances. Necessary and sufficient conditions for output agreement are derived for the class of incrementally passive systems. Following this, it is shown that the optimal distribution problem in dynamic inventory systems with time-varying supply and demand can be cast as a special version of the output agreement problem. We show in particular that the time-varying optimal distribution problem can be solved by applying an internal model controller to the dual variables of a certain convex network optimization problem. △ Less

Submitted 4 February, 2013; originally announced February 2013.

Comments: 14 pages; submitted to the 9th IFAC Symposium on Nonlinear Control Systems (NOLCOS2013)

Duality and Network Theory in Passivity-based Cooperative Control

Authors: Mathias Bürger, Daniel Zelazo, Frank Allgöwer

Abstract: This paper presents a class of passivity-based cooperative control problems that have an explicit connection to convex network optimization problems. The new notion of maximal equilibrium independent passivity is introduced and it is shown that networks of systems possessing this property asymptotically approach the solutions of a dual pair of network optimization problems, namely an optimal poten… ▽ More This paper presents a class of passivity-based cooperative control problems that have an explicit connection to convex network optimization problems. The new notion of maximal equilibrium independent passivity is introduced and it is shown that networks of systems possessing this property asymptotically approach the solutions of a dual pair of network optimization problems, namely an optimal potential and an optimal flow problem. This connection leads to an interpretation of the dynamic variables, such as system inputs and outputs, to variables in a network optimization framework, such as divergences and potentials, and reveals that several duality relations known in convex network optimization theory translate directly to passivity-based cooperative control problems. The presented results establish a strong and explicit connection between passivity-based cooperative control theory on the one side and network optimization theory on the other, and they provide a unifying framework for network analysis and optimal design. The results are illustrated on a nonlinear traffic dynamics model that is shown to be asymptotically clustering. △ Less

Submitted 2 September, 2013; v1 submitted 16 January, 2013; originally announced January 2013.

Comments: submitted to Automatica (revised version)