-
Deep Compressed Learning for 3D Seismic Inversion
Authors:
Maayan Gelboim,
Amir Adler,
Yen Sun,
Mauricio Araya-Polo
Abstract:
We consider the problem of 3D seismic inversion from pre-stack data using a very small number of seismic sources. The proposed solution is based on a combination of compressed-sensing and machine learning frameworks, known as compressed-learning. The solution jointly optimizes a dimensionality reduction operator and a 3D inversion encoder-decoder implemented by a deep convolutional neural network…
▽ More
We consider the problem of 3D seismic inversion from pre-stack data using a very small number of seismic sources. The proposed solution is based on a combination of compressed-sensing and machine learning frameworks, known as compressed-learning. The solution jointly optimizes a dimensionality reduction operator and a 3D inversion encoder-decoder implemented by a deep convolutional neural network (DCNN). Dimensionality reduction is achieved by learning a sparse binary sensing layer that selects a small subset of the available sources, then the selected data is fed to a DCNN to complete the regression task. The end-to-end learning process provides a reduction by an order-of-magnitude in the number of seismic records used during training, while preserving the 3D reconstruction quality comparable to that obtained by using the entire dataset.
△ Less
Submitted 31 October, 2023;
originally announced November 2023.
-
Estimating True Beliefs in Opinion Dynamics with Social Pressure
Authors:
Jennifer Tang,
Aviv Adler,
Amir Ajorlou,
Ali Jadbabaie
Abstract:
Social networks often exert social pressure, causing individuals to adapt their expressed opinions to conform to their peers. An agent in such systems can be modeled as having a (true and unchanging) inherent belief while broadcasting a declared opinion at each time step based on her inherent belief and the past declared opinions of her neighbors. An important question in this setting is parameter…
▽ More
Social networks often exert social pressure, causing individuals to adapt their expressed opinions to conform to their peers. An agent in such systems can be modeled as having a (true and unchanging) inherent belief while broadcasting a declared opinion at each time step based on her inherent belief and the past declared opinions of her neighbors. An important question in this setting is parameter estimation: how to disentangle the effects of social pressure to estimate inherent beliefs from declared opinions. This is useful for forecasting when agents' declared opinions are influenced by social pressure while real-world behavior only depends on their inherent beliefs. To address this, Jadbabaie et al. formulated the Interacting Pólya Urn model of opinion dynamics under social pressure and studied it on complete-graph social networks using an aggregate estimator, and found that their estimator converges to the inherent beliefs unless majority pressure pushes the network to consensus.
In this work, we studythis model on arbitrary networks, providing an estimator which converges to the inherent beliefs even in consensus situations. Finally, we bound the convergence rate of our estimator in both consensus and non-consensus scenarios; to get the bound for consensus scenarios (which converge slower than non-consensus) we additionally found how quickly the system converges to consensus.
△ Less
Submitted 26 June, 2024; v1 submitted 26 October, 2023;
originally announced October 2023.
-
Stochastic Opinion Dynamics under Social Pressure in Arbitrary Networks
Authors:
Jennifer Tang,
Aviv Adler,
Amir Ajorlou,
Ali Jadbabaie
Abstract:
Social pressure is a key factor affecting the evolution of opinions on networks in many types of settings, pushing people to conform to their neighbors' opinions. To study this, the interacting Polya urn model was introduced by Jadbabaie et al., in which each agent has two kinds of opinion: inherent beliefs, which are hidden from the other agents and fixed; and declared opinions, which are randoml…
▽ More
Social pressure is a key factor affecting the evolution of opinions on networks in many types of settings, pushing people to conform to their neighbors' opinions. To study this, the interacting Polya urn model was introduced by Jadbabaie et al., in which each agent has two kinds of opinion: inherent beliefs, which are hidden from the other agents and fixed; and declared opinions, which are randomly sampled at each step from a distribution which depends on the agent's inherent belief and her neighbors' past declared opinions (the social pressure component), and which is then communicated to her neighbors. Each agent also has a bias parameter denoting her level of resistance to social pressure. At every step, each agent updates her declared opinion (simultaneously with all other agents) according to her neighbors' aggregate past declared opinions, her inherent belief, and her bias parameter. We study the asymptotic behavior of this opinion dynamics model and show that the agents' declaration probabilities approaches a set of equilibrium points of the expected dynamics using Lyapunov theory and stochastic approximation techniques. We also derive necessary and sufficient conditions for the agents to approach consensus on their declared opinions. Our work provides further insight into the difficulty of inferring the inherent beliefs of agents when they are under social pressure.
△ Less
Submitted 30 September, 2024; v1 submitted 17 August, 2023;
originally announced August 2023.
-
An F-ratio-Based Method for Estimating the Number of Active Sources in MEG
Authors:
Amita Giri,
John C. Mosher,
Amir Adler,
Dimitrios Pantazis
Abstract:
Magnetoencephalography (MEG) is a powerful technique for studying the human brain function. However, accurately estimating the number of sources that contribute to the MEG recordings remains a challenging problem due to the low signal-to-noise ratio (SNR), the presence of correlated sources, inaccuracies in head modeling, and variations in individual anatomy. To address these issues, our study int…
▽ More
Magnetoencephalography (MEG) is a powerful technique for studying the human brain function. However, accurately estimating the number of sources that contribute to the MEG recordings remains a challenging problem due to the low signal-to-noise ratio (SNR), the presence of correlated sources, inaccuracies in head modeling, and variations in individual anatomy. To address these issues, our study introduces a robust method for accurately estimating the number of active sources in the brain based on the F-ratio statistical approach, which allows for a comparison between a full model with a higher number of sources and a reduced model with fewer sources. Using this approach, we developed a formal statistical procedure that sequentially increases the number of sources in the multiple dipole localization problem until all sources are found. Our results revealed that the selection of thresholds plays a critical role in determining the method`s overall performance, and appropriate thresholds needed to be adjusted for the number of sources and SNR levels, while they remained largely invariant to different inter-source correlations, modeling inaccuracies, and different cortical anatomies. By identifying optimal thresholds and validating our F-ratio-based method in simulated, real phantom, and human MEG data, we demonstrated the superiority of our F-ratio-based method over existing state-of-the-art statistical approaches, such as the Akaike Information Criterion (AIC) and Minimum Description Length (MDL). Overall, when tuned for optimal selection of thresholds, our method offers researchers a precise tool to estimate the true number of active brain sources and accurately model brain function.
△ Less
Submitted 9 June, 2023;
originally announced June 2023.
-
Encoder-Decoder Architecture for 3D Seismic Inversion
Authors:
Maayan Gelboim,
Amir Adler,
Yen Sun,
Mauricio Araya-Polo
Abstract:
Inverting seismic data to build 3D geological structures is a challenging task due to the overwhelming amount of acquired seismic data, and the very-high computational load due to iterative numerical solutions of the wave equation, as required by industry-standard tools such as Full Waveform Inversion (FWI). For example, in an area with surface dimensions of 4.5km $\times$ 4.5km, hundreds of seism…
▽ More
Inverting seismic data to build 3D geological structures is a challenging task due to the overwhelming amount of acquired seismic data, and the very-high computational load due to iterative numerical solutions of the wave equation, as required by industry-standard tools such as Full Waveform Inversion (FWI). For example, in an area with surface dimensions of 4.5km $\times$ 4.5km, hundreds of seismic shot-gather cubes are required for 3D model reconstruction, leading to Terabytes of recorded data. This paper presents a deep learning solution for the reconstruction of realistic 3D models in the presence of field noise recorded in seismic surveys. We implement and analyze a convolutional encoder-decoder architecture that efficiently processes the entire collection of hundreds of seismic shot-gather cubes. The proposed solution demonstrates that realistic 3D models can be reconstructed with a structural similarity index measure (SSIM) of 0.8554 (out of 1.0) in the presence of field noise at 10dB signal-to-noise ratio.
△ Less
Submitted 29 July, 2022;
originally announced July 2022.
-
The Role of Heterogeneity in Autonomous Perimeter Defense Problems
Authors:
Aviv Adler,
Oscar Mickelin,
Ragesh K. Ramachandran,
Gaurav S. Sukhatme,
Sertac Karaman
Abstract:
When is heterogeneity in the composition of an autonomous robotic team beneficial and when is it detrimental? We investigate and answer this question in the context of a minimally viable model that examines the role of heterogeneous speeds in perimeter defense problems, where defenders share a total allocated speed budget. We consider two distinct problem settings and develop strategies based on d…
▽ More
When is heterogeneity in the composition of an autonomous robotic team beneficial and when is it detrimental? We investigate and answer this question in the context of a minimally viable model that examines the role of heterogeneous speeds in perimeter defense problems, where defenders share a total allocated speed budget. We consider two distinct problem settings and develop strategies based on dynamic programming and on local interaction rules. We present a theoretical analysis of both approaches and our results are extensively validated using simulations. Interestingly, our results demonstrate that the viability of heterogeneous teams depends on the amount of information available to the defenders. Moreover, our results suggest a universality property: across a wide range of problem parameters the optimal ratio of the speeds of the defenders remains nearly constant.
△ Less
Submitted 21 February, 2022;
originally announced February 2022.
-
Brain Source Localization by Alternating Projection
Authors:
Amir Adler,
Mati Wax,
Dimitrios Pantazis
Abstract:
We present a novel solution to the problem of localizing magnetoencephalography (MEG) and electroencephalography (EEG) brain signals. The solution is sequential and iterative, and is based on minimizing the least-squares criterion by the Alternating Projection algorithm. Results from simulated and experimental MEG data from a human subject demonstrated robust performance, with consistently superio…
▽ More
We present a novel solution to the problem of localizing magnetoencephalography (MEG) and electroencephalography (EEG) brain signals. The solution is sequential and iterative, and is based on minimizing the least-squares criterion by the Alternating Projection algorithm. Results from simulated and experimental MEG data from a human subject demonstrated robust performance, with consistently superior localization accuracy than scanning methods belonging to the beamformer and multiple-signal classification (MUSIC) families. Importantly, the proposed solution is more robust to forward model errors resulting from head rotations and translations, with a significant advantage in highly correlated sources.
△ Less
Submitted 2 February, 2022;
originally announced February 2022.
-
The Simons Observatory: HoloSim-ML: machine learning applied to the efficient analysis of radio holography measurements of complex optical systems
Authors:
Grace E. Chesmore,
Alexandre E. Adler,
Nicholas F. Cothard,
Nadia Dachlythra,
Patricio A. Gallardo,
Jon Gudmundsson,
Bradley R. Johnson,
Michele Limon,
Jeff McMahon,
Federico Nati,
Michael D. Niemack,
Giuseppe Puglisi,
Sara M. Simon,
Edward J. Wollack,
Kevin Wolz,
Zhilei Xu,
Ningfeng Zhu
Abstract:
Near-field radio holography is a common method for measuring and aligning mirror surfaces for millimeter and sub-millimeter telescopes. In instruments with more than a single mirror, degeneracies arise in the holography measurement, requiring multiple measurements and new fitting methods. We present HoloSim-ML, a Python code for beam simulation and analysis of radio holography data from complex op…
▽ More
Near-field radio holography is a common method for measuring and aligning mirror surfaces for millimeter and sub-millimeter telescopes. In instruments with more than a single mirror, degeneracies arise in the holography measurement, requiring multiple measurements and new fitting methods. We present HoloSim-ML, a Python code for beam simulation and analysis of radio holography data from complex optical systems. This code uses machine learning to efficiently determine the position of hundreds of mirror adjusters on multiple mirrors with few micron accuracy. We apply this approach to the example of the Simons Observatory 6m telescope.
△ Less
Submitted 5 October, 2021; v1 submitted 8 July, 2021;
originally announced July 2021.
-
MEG Source Localization via Deep Learning
Authors:
Dimitrios Pantazis,
Amir Adler
Abstract:
We present a deep learning solution to the problem of localization of magnetoencephalography (MEG) brain signals. The proposed deep model architectures are tuned for single and multiple time point MEG data, and can estimate varying numbers of dipole sources. Results from simulated MEG data on the cortical surface of a real human subject demonstrated improvements against the popular RAP-MUSIC local…
▽ More
We present a deep learning solution to the problem of localization of magnetoencephalography (MEG) brain signals. The proposed deep model architectures are tuned for single and multiple time point MEG data, and can estimate varying numbers of dipole sources. Results from simulated MEG data on the cortical surface of a real human subject demonstrated improvements against the popular RAP-MUSIC localization algorithm in specific scenarios with varying SNR levels, inter-source correlation values, and number of sources. Importantly, the deep learning models had robust performance to forward model errors and a significant reduction in computation time, to a fraction of 1 ms, paving the way to real-time MEG source localization.
△ Less
Submitted 1 December, 2020;
originally announced December 2020.
-
Localization of MEG and EEG Brain Signals by Alternating Projection
Authors:
Amir Adler,
Mati Wax,
Dimitrios Pantazis
Abstract:
We present a novel solution to the problem of localization of MEG and EEG brain signals. The solution is sequential and iterative, and is based on minimizing the least-squares (LS)criterion by the Alternating Projection (AP) algorithm, which is well known in the context of array signal processing. Unlike existing scanning solutions belonging to the beamformer and multiple-signal classification (MU…
▽ More
We present a novel solution to the problem of localization of MEG and EEG brain signals. The solution is sequential and iterative, and is based on minimizing the least-squares (LS)criterion by the Alternating Projection (AP) algorithm, which is well known in the context of array signal processing. Unlike existing scanning solutions belonging to the beamformer and multiple-signal classification (MUSIC) families, the algorithm has good performance in low signal-to-noise ratio (SNR) and can cope with closely spaced sources and any mixture of correlated sources. Results from simulated and experimental MEG data from a real phantom demonstrated robust performance across an extended SNR range, the entire inter-source correlation range, and across multiple sources, with consistently superior localization accuracy than popular scanning methods.
△ Less
Submitted 25 November, 2020; v1 submitted 29 August, 2019;
originally announced August 2019.
-
Deep Recurrent Architectures for Seismic Tomography
Authors:
Amir Adler,
Mauricio Araya-Polo,
Tomaso Poggio
Abstract:
This paper introduces novel deep recurrent neural network architectures for Velocity Model Building (VMB), which is beyond what Araya-Polo et al 2018 pioneered with the Machine Learning-based seismic tomography built with convolutional non-recurrent neural network. Our investigation includes the utilization of basic recurrent neural network (RNN) cells, as well as Long Short Term Memory (LSTM) and…
▽ More
This paper introduces novel deep recurrent neural network architectures for Velocity Model Building (VMB), which is beyond what Araya-Polo et al 2018 pioneered with the Machine Learning-based seismic tomography built with convolutional non-recurrent neural network. Our investigation includes the utilization of basic recurrent neural network (RNN) cells, as well as Long Short Term Memory (LSTM) and Gated Recurrent Unit (GRU) cells. Performance evaluation reveals that salt bodies are consistently predicted more accurately by GRU and LSTM-based architectures, as compared to non-recurrent architectures. The results take us a step closer to the final goal of a reliable fully Machine Learning-based tomography from pre-stack data, which when achieved will reduce the VMB turnaround from weeks to days.
△ Less
Submitted 12 August, 2019;
originally announced August 2019.
-
Deep Learning of Compressed Sensing Operators with Structural Similarity Loss
Authors:
Yochai Zur,
Amir Adler
Abstract:
Compressed sensing (CS) is a signal processing framework for efficiently reconstructing a signal from a small number of measurements, obtained by linear projections of the signal. In this paper we present an end-to-end deep learning approach for CS, in which a fully-connected network performs both the linear sensing and non-linear reconstruction stages. During the training phase, the sensing matri…
▽ More
Compressed sensing (CS) is a signal processing framework for efficiently reconstructing a signal from a small number of measurements, obtained by linear projections of the signal. In this paper we present an end-to-end deep learning approach for CS, in which a fully-connected network performs both the linear sensing and non-linear reconstruction stages. During the training phase, the sensing matrix and the non-linear reconstruction operator are jointly optimized using Structural similarity index (SSIM) as loss rather than the standard Mean Squared Error (MSE) loss. We compare the proposed approach with state-of-the-art in terms of reconstruction quality under both losses, i.e. SSIM score and MSE score.
△ Less
Submitted 25 June, 2019;
originally announced June 2019.
-
Direct Localization of Multiple Sources by Partly Calibrated Arrays
Authors:
Amir Adler,
Mati Wax
Abstract:
We present novel solutions to the problem of direct localization of multiple narrow-band and arbitrarily correlated sources by partly calibrated arrays, i.e., arrays composed of fully calibrated sub-arrays yet lacking inter-array calibration. The solutions presented vary in their performance and computational complexity. We present first a relaxed maximum likelihood solution whose concentrated lik…
▽ More
We present novel solutions to the problem of direct localization of multiple narrow-band and arbitrarily correlated sources by partly calibrated arrays, i.e., arrays composed of fully calibrated sub-arrays yet lacking inter-array calibration. The solutions presented vary in their performance and computational complexity. We present first a relaxed maximum likelihood solution whose concentrated likelihood involves only the unknown locations of the sources and requires an eigen-decomposition of the array covariance matrix at every potential location. To reduce the computational load, we introduce an approximation which eliminates the need for such an eigen-decomposition at every potential location. To further reduce the computational load, novel MUSIC-like and MVDR-like solutions are presented which are computationally much simpler than the existing solutions. The performance of these solutions is evaluated and compared via simulations.
△ Less
Submitted 25 July, 2018;
originally announced July 2018.
