-
Model Agnostic Combination for Ensemble Learning
Authors:
Ohad Silbert,
Yitzhak Peleg,
Evi Kopelowitz
Abstract:
Ensemble of models is well known to improve single model performance. We present a novel ensembling technique coined MAC that is designed to find the optimal function for combining models while remaining invariant to the number of sub-models involved in the combination. Being agnostic to the number of sub-models enables addition and replacement of sub-models to the combination even after deploymen…
▽ More
Ensemble of models is well known to improve single model performance. We present a novel ensembling technique coined MAC that is designed to find the optimal function for combining models while remaining invariant to the number of sub-models involved in the combination. Being agnostic to the number of sub-models enables addition and replacement of sub-models to the combination even after deployment, unlike many of the current methods for ensembling such as stacking, boosting, mixture of experts and super learners that lock the models used for combination during training and therefore need retraining whenever a new model is introduced into the ensemble. We show that on the Kaggle RSNA Intracranial Hemorrhage Detection challenge, MAC outperforms classical average methods, demonstrates competitive results to boosting via XGBoost for a fixed number of sub-models, and outperforms it when adding sub-models to the combination without retraining.
△ Less
Submitted 16 June, 2020;
originally announced June 2020.
-
Lung Nodules Detection and Segmentation Using 3D Mask-RCNN
Authors:
Evi Kopelowitz,
Guy Engelhard
Abstract:
Accurate assessment of Lung nodules is a time consuming and error prone ingredient of the radiologist interpretation work. Automating 3D volume detection and segmentation can improve workflow as well as patient care. Previous works have focused either on detecting lung nodules from a full CT scan or on segmenting them from a small ROI. We adapt the state of the art architecture for 2D object detec…
▽ More
Accurate assessment of Lung nodules is a time consuming and error prone ingredient of the radiologist interpretation work. Automating 3D volume detection and segmentation can improve workflow as well as patient care. Previous works have focused either on detecting lung nodules from a full CT scan or on segmenting them from a small ROI. We adapt the state of the art architecture for 2D object detection and segmentation, MaskRCNN, to handle 3D images and employ it to detect and segment lung nodules from CT scans. We report on competitive results for the lung nodule detection on LUNA16 data set. The added value of our method is that in addition to lung nodule detection, our framework produces 3D segmentations of the detected nodules.
△ Less
Submitted 17 July, 2019;
originally announced July 2019.
-
Synthetic reverberating activity patterns embedded in networks of cortical neurons
Authors:
Roni Vardi,
Avner Wallach,
Evi Kopelowitz,
Moshe Abeles,
Shimon Marom,
Ido Kanter
Abstract:
Synthetic reverberating activity patterns are experimentally generated by stimulation of a subset of neurons embedded in a spontaneously active network of cortical cells in-vitro. The neurons are artificially connected by means of conditional stimulation matrix, forming a synthetic local circuit with a predefined programmable connectivity and time-delays. Possible uses of this experimental design…
▽ More
Synthetic reverberating activity patterns are experimentally generated by stimulation of a subset of neurons embedded in a spontaneously active network of cortical cells in-vitro. The neurons are artificially connected by means of conditional stimulation matrix, forming a synthetic local circuit with a predefined programmable connectivity and time-delays. Possible uses of this experimental design are demonstrated, analyzing the sensitivity of these deterministic activity patterns to transmission delays and to the nature of ongoing network dynamics.
△ Less
Submitted 26 March, 2012; v1 submitted 1 January, 2012;
originally announced January 2012.
-
Nonlocal mechanism for cluster synchronization in neural circuits
Authors:
I. Kanter,
E. Kopelowitz,
R. Vardi,
M. Zigzag,
W. Kinzel,
M. Abeles,
D. Cohen
Abstract:
The interplay between the topology of cortical circuits and synchronized activity modes in distinct cortical areas is a key enigma in neuroscience. We present a new nonlocal mechanism governing the periodic activity mode: the greatest common divisor (GCD) of network loops. For a stimulus to one node, the network splits into GCD-clusters in which cluster neurons are in zero-lag synchronization. For…
▽ More
The interplay between the topology of cortical circuits and synchronized activity modes in distinct cortical areas is a key enigma in neuroscience. We present a new nonlocal mechanism governing the periodic activity mode: the greatest common divisor (GCD) of network loops. For a stimulus to one node, the network splits into GCD-clusters in which cluster neurons are in zero-lag synchronization. For complex external stimuli, the number of clusters can be any common divisor. The synchronized mode and the transients to synchronization pinpoint the type of external stimuli. The findings, supported by an information mixing argument and simulations of Hodgkin Huxley population dynamic networks with unidirectional connectivity and synaptic noise, call for reexamining sources of correlated activity in cortex and shorter information processing time scales.
△ Less
Submitted 18 March, 2011;
originally announced March 2011.
-
Public Channel Cryptography: Chaos Synchronization and Hilbert's Tenth Problem
Authors:
Ido Kanter,
Evi Kopelowitz,
Wolfgang Kinzel
Abstract:
The synchronization process of two mutually delayed coupled deterministic chaotic maps is demonstrated both analytically and numerically. The synchronization is preserved when the mutually transmitted signal is concealed by two commutative private filters that are placed on each end of the communication channel. We demonstrate that when the transmitted signal is a convolution of the truncated ti…
▽ More
The synchronization process of two mutually delayed coupled deterministic chaotic maps is demonstrated both analytically and numerically. The synchronization is preserved when the mutually transmitted signal is concealed by two commutative private filters that are placed on each end of the communication channel. We demonstrate that when the transmitted signal is a convolution of the truncated time delayed output signals or some powers of the delayed output signals synchronization is still maintained. The task of a passive attacker is mapped onto Hilbert's tenth problem, solving a set of nonlinear Diophantine equations, which was proven to be in the class of NP-Complete problems. This bridge between two different disciplines, synchronization in nonlinear dynamical processes and the realm of the NPC problems, opens a horizon for a new type of secure public-channel protocols.
△ Less
Submitted 5 June, 2008;
originally announced June 2008.
-
Patterns of Chaos Synchronization
Authors:
Johannes Kestler,
Evi Kopelowitz,
Ido Kanter,
Wolfgang Kinzel
Abstract:
Small networks of chaotic units which are coupled by their time-delayed variables, are investigated. In spite of the time delay, the units can synchronize isochronally, i.e. without time shift. Moreover, networks can not only synchronize completely, but can also split into different synchronized sublattices. These synchronization patterns are stable attractors of the network dynamics. Different…
▽ More
Small networks of chaotic units which are coupled by their time-delayed variables, are investigated. In spite of the time delay, the units can synchronize isochronally, i.e. without time shift. Moreover, networks can not only synchronize completely, but can also split into different synchronized sublattices. These synchronization patterns are stable attractors of the network dynamics. Different networks with their associated behaviors and synchronization patterns are presented. In particular, we investigate sublattice synchronization, symmetry breaking, spreading chaotic motifs, synchronization by restoring symmetry and cooperative pairwise synchronization of a bipartite tree.
△ Less
Submitted 3 January, 2008;
originally announced January 2008.
-
Chaos Synchronization with Dynamic Filters: Two Way is Better Than One Way
Authors:
Ido Kanter,
Evi Kopelowitz,
Johannes Kestler,
Wolfgang Kinzel
Abstract:
Two chaotic systems which interact by mutually exchanging a signal built from their delayed internal variables, can synchronize. A third unit may be able to record and to manipulate the exchanged signal. Can the third unit synchronize to the common chaotic trajectory, as well? If all parameters of the system are public, a proof is given that the recording system can synchronize as well. However,…
▽ More
Two chaotic systems which interact by mutually exchanging a signal built from their delayed internal variables, can synchronize. A third unit may be able to record and to manipulate the exchanged signal. Can the third unit synchronize to the common chaotic trajectory, as well? If all parameters of the system are public, a proof is given that the recording system can synchronize as well. However, if the two interacting systems use private commutative filters to generate the exchanged signal, a driven system cannot synchronize. It is shown that with dynamic private filters the chaotic trajectory even cannot be calculated. Hence two way (interaction) is more than one way (drive). The implication of this general result to secret communication with chaos synchronization is discussed.
△ Less
Submitted 17 December, 2007;
originally announced December 2007.
-
Spiking Optical Patterns and Synchronization
Authors:
Michael Rosenbluh,
Yaara Aviad,
Elad Cohen,
Lev Khaykovich,
Wolfgang Kinzel,
Evi Kopelowitz,
Pinhas Yoskovits,
Ido Kanter
Abstract:
We analyze the time resolved spike statistics of a solitary and two mutually interacting chaotic semiconductor lasers whose chaos is characterized by apparently random, short intensity spikes. Repulsion between two successive spikes is observed, resulting in a refractory period which is largest at laser threshold. For time intervals between spikes greater than the refractory period, the distribu…
▽ More
We analyze the time resolved spike statistics of a solitary and two mutually interacting chaotic semiconductor lasers whose chaos is characterized by apparently random, short intensity spikes. Repulsion between two successive spikes is observed, resulting in a refractory period which is largest at laser threshold. For time intervals between spikes greater than the refractory period, the distribution of the intervals follows a Poisson distribution. The spiking pattern is highly periodic over time windows corresponding to the optical length of the external cavity, with a slow change of the spiking pattern as time increases. When zero-lag synchronization between the two lasers is established, the statistics of the nearly perfectly matched spikes are not altered. The similarity of these features to those found in complex interacting neural networks, suggests the use of laser systems as simpler physical models for neural networks.
△ Less
Submitted 11 June, 2007;
originally announced June 2007.
-
Synchronization of mutually coupled chaotic lasers in the presence of a shutter
Authors:
Ido Kanter,
Noam Gross,
Einat Klein,
Evi Kopelowitz,
Pinhas Yoskovits,
Lev Khaykovich,
Wolfgang Kinzel,
Michael Rosenbluh
Abstract:
Two mutually coupled chaotic diode lasers exhibit stable isochronal synchronization in the presence of self feedback. When the mutual communication between the lasers is discontinued by a shutter and the two uncoupled lasers are subject to self-feedback only, the desynchronization time is found to scale as $A_dτ$ where $A_d>1$ and $τ$ corresponds to the optical distance between the lasers. Prior…
▽ More
Two mutually coupled chaotic diode lasers exhibit stable isochronal synchronization in the presence of self feedback. When the mutual communication between the lasers is discontinued by a shutter and the two uncoupled lasers are subject to self-feedback only, the desynchronization time is found to scale as $A_dτ$ where $A_d>1$ and $τ$ corresponds to the optical distance between the lasers. Prior to synchronization, when the two lasers are uncorrelated and the shutter between them is opened, the synchronization time is found to be much shorter, though still proportional to $τ$. As a consequence of these results, the synchronization is not significantly altered if the shutter is opend/closed faster than the desynchronization time. Experiments in which the coupling between two chaotic-synchronized diode lasers is modulated with an electro-optic shutter are found to be consistent with the results of numerical simulations.
△ Less
Submitted 15 October, 2006;
originally announced October 2006.
-
Public-channel cryptography based on mutual chaos pass filters
Authors:
Einat Klein,
Noam Gross,
Evi Kopelowitz,
Michael Rosenbluh,
Lev Khaykovich,
Wolfgang Kinzel,
Ido Kanter
Abstract:
We study the mutual coupling of chaotic lasers and observe both experimentally and in numeric simulations, that there exists a regime of parameters for which two mutually coupled chaotic lasers establish isochronal synchronization, while a third laser coupled unidirectionally to one of the pair, does not synchronize. We then propose a cryptographic scheme, based on the advantage of mutual-coupli…
▽ More
We study the mutual coupling of chaotic lasers and observe both experimentally and in numeric simulations, that there exists a regime of parameters for which two mutually coupled chaotic lasers establish isochronal synchronization, while a third laser coupled unidirectionally to one of the pair, does not synchronize. We then propose a cryptographic scheme, based on the advantage of mutual-coupling over unidirectional coupling, where all the parameters of the system are public knowledge. We numerically demonstrate that in such a scheme the two communicating lasers can add a message signal (compressed binary message) to the transmitted coupling signal, and recover the message in both directions with high fidelity by using a mutual chaos pass filter procedure. An attacker however, fails to recover an errorless message even if he amplifies the coupling signal.
△ Less
Submitted 25 April, 2006;
originally announced April 2006.