-
Unity is strength: Improving the Detection of Adversarial Examples with Ensemble Approaches
Authors:
Francesco Craighero,
Fabrizio Angaroni,
Fabio Stella,
Chiara Damiani,
Marco Antoniotti,
Alex Graudenzi
Abstract:
A key challenge in computer vision and deep learning is the definition of robust strategies for the detection of adversarial examples. Here, we propose the adoption of ensemble approaches to leverage the effectiveness of multiple detectors in exploiting distinct properties of the input data. To this end, the ENsemble Adversarial Detector (ENAD) framework integrates scoring functions from state-of-…
▽ More
A key challenge in computer vision and deep learning is the definition of robust strategies for the detection of adversarial examples. Here, we propose the adoption of ensemble approaches to leverage the effectiveness of multiple detectors in exploiting distinct properties of the input data. To this end, the ENsemble Adversarial Detector (ENAD) framework integrates scoring functions from state-of-the-art detectors based on Mahalanobis distance, Local Intrinsic Dimensionality, and One-Class Support Vector Machines, which process the hidden features of deep neural networks. ENAD is designed to ensure high standardization and reproducibility to the computational workflow. Importantly, extensive tests on benchmark datasets, models and adversarial attacks show that ENAD outperforms all competing methods in the large majority of settings. The improvement over the state-of-the-art and the intrinsic generality of the framework, which allows one to easily extend ENAD to include any set of detectors, set the foundations for the new area of ensemble adversarial detection.
△ Less
Submitted 15 February, 2022; v1 submitted 24 November, 2021;
originally announced November 2021.
-
Why You Cannot (Yet) Write an "Interval Arithmetic" Library in Common Lisp
Authors:
Marco Antoniotti
Abstract:
"Interval Arithmetic" (IA) appears to be a useful numerical tool to have at hand in several applications. Alas, the current IA descriptions and proposed standards are always formulated in terms of the IEEE-754 standard, and the status of IEEE-754 compliance of most Common Lisp implementations is not up to par. A solution would be for Common Lisp implementations to adhere to the Language Independen…
▽ More
"Interval Arithmetic" (IA) appears to be a useful numerical tool to have at hand in several applications. Alas, the current IA descriptions and proposed standards are always formulated in terms of the IEEE-754 standard, and the status of IEEE-754 compliance of most Common Lisp implementations is not up to par. A solution would be for Common Lisp implementations to adhere to the Language Independent Arithmetic} (LIA) IEC standard, which includes IEEE/754. While the LIA standard provides a set of proposed bindings for Common Lisp, the format and depth of the specification documents is not readily usable by a Common Lisp programmer, should an implementation decide to comply with the provisions. Moreover, much latitude is left to each implementation to provide the LIA "environmental" setup. It would be most beneficial if more precision were agreed upon by the Common Lisp community about how to provide LIA compliance in the implementations. In that case, a new set of documentation or manuals in the style of the HyperSpec could be provided, for the benefit of the Common Lisp programmer.
△ Less
Submitted 21 April, 2020; v1 submitted 8 March, 2020;
originally announced March 2020.
-
Investigating the Compositional Structure Of Deep Neural Networks
Authors:
Francesco Craighero,
Fabrizio Angaroni,
Alex Graudenzi,
Fabio Stella,
Marco Antoniotti
Abstract:
The current understanding of deep neural networks can only partially explain how input structure, network parameters and optimization algorithms jointly contribute to achieve the strong generalization power that is typically observed in many real-world applications. In order to improve the comprehension and interpretability of deep neural networks, we here introduce a novel theoretical framework b…
▽ More
The current understanding of deep neural networks can only partially explain how input structure, network parameters and optimization algorithms jointly contribute to achieve the strong generalization power that is typically observed in many real-world applications. In order to improve the comprehension and interpretability of deep neural networks, we here introduce a novel theoretical framework based on the compositional structure of piecewise linear activation functions. By defining a direct acyclic graph representing the composition of activation patterns through the network layers, it is possible to characterize the instances of the input data with respect to both the predicted label and the specific (linear) transformation used to perform predictions. Preliminary tests on the MNIST dataset show that our method can group input instances with regard to their similarity in the internal representation of the neural network, providing an intuitive measure of input complexity.
△ Less
Submitted 17 February, 2020;
originally announced February 2020.
-
Learning mutational graphs of individual tumour evolution from single-cell and multi-region sequencing data
Authors:
Daniele Ramazzotti,
Alex Graudenzi,
Luca De Sano,
Marco Antoniotti,
Giulio Caravagna
Abstract:
Background. A large number of algorithms is being developed to reconstruct evolutionary models of individual tumours from genome sequencing data. Most methods can analyze multiple samples collected either through bulk multi-region sequencing experiments or the sequencing of individual cancer cells. However, rarely the same method can support both data types.
Results. We introduce TRaIT, a comput…
▽ More
Background. A large number of algorithms is being developed to reconstruct evolutionary models of individual tumours from genome sequencing data. Most methods can analyze multiple samples collected either through bulk multi-region sequencing experiments or the sequencing of individual cancer cells. However, rarely the same method can support both data types.
Results. We introduce TRaIT, a computational framework to infer mutational graphs that model the accumulation of multiple types of somatic alterations driving tumour evolution. Compared to other tools, TRaIT supports multi-region and single-cell sequencing data within the same statistical framework, and delivers expressive models that capture many complex evolutionary phenomena. TRaIT improves accuracy, robustness to data-specific errors and computational complexity compared to competing methods.
Conclusions. We show that the application of TRaIT to single-cell and multi-region cancer datasets can produce accurate and reliable models of single-tumour evolution, quantify the extent of intra-tumour heterogeneity and generate new testable experimental hypotheses.
△ Less
Submitted 22 March, 2019; v1 submitted 4 September, 2017;
originally announced September 2017.
-
cyTRON and cyTRON/JS: two Cytoscape-based applications for the inference of cancer evolution models
Authors:
Lucrezia Patruno,
Edoardo Galimberti,
Daniele Ramazzotti,
Giulio Caravagna,
Luca De Sano,
Marco Antoniotti,
Alex Graudenzi
Abstract:
The increasing availability of sequencing data of cancer samples is fueling the development of algorithmic strategies to investigate tumor heterogeneity and infer reliable models of cancer evolution. We here build up on previous works on cancer progression inference from genomic alteration data, to deliver two distinct Cytoscape-based applications, which allow to produce, visualize and manipulate…
▽ More
The increasing availability of sequencing data of cancer samples is fueling the development of algorithmic strategies to investigate tumor heterogeneity and infer reliable models of cancer evolution. We here build up on previous works on cancer progression inference from genomic alteration data, to deliver two distinct Cytoscape-based applications, which allow to produce, visualize and manipulate cancer evolution models, also by interacting with public genomic and proteomics databases. In particular, we here introduce cyTRON, a stand-alone Cytoscape app, and cyTRON/JS, a web application which employs the functionalities of Cytoscape/JS.
cyTRON was developed in Java; the code is available at https://github.com/BIMIB-DISCo/cyTRON and on the Cytoscape App Store http://apps.cytoscape.org/apps/cytron. cyTRON/JS was developed in JavaScript and R; the source code of the tool is available at https://github.com/BIMIB-DISCo/cyTRON-js and the tool is accessible from https://bimib.disco.unimib.it/cytronjs/welcome.
△ Less
Submitted 20 July, 2019; v1 submitted 8 May, 2017;
originally announced May 2017.
-
Efficient computational strategies to learn the structure of probabilistic graphical models of cumulative phenomena
Authors:
Daniele Ramazzotti,
Marco S. Nobile,
Marco Antoniotti,
Alex Graudenzi
Abstract:
Structural learning of Bayesian Networks (BNs) is a NP-hard problem, which is further complicated by many theoretical issues, such as the I-equivalence among different structures. In this work, we focus on a specific subclass of BNs, named Suppes-Bayes Causal Networks (SBCNs), which include specific structural constraints based on Suppes' probabilistic causation to efficiently model cumulative phe…
▽ More
Structural learning of Bayesian Networks (BNs) is a NP-hard problem, which is further complicated by many theoretical issues, such as the I-equivalence among different structures. In this work, we focus on a specific subclass of BNs, named Suppes-Bayes Causal Networks (SBCNs), which include specific structural constraints based on Suppes' probabilistic causation to efficiently model cumulative phenomena. Here we compare the performance, via extensive simulations, of various state-of-the-art search strategies, such as local search techniques and Genetic Algorithms, as well as of distinct regularization methods. The assessment is performed on a large number of simulated datasets from topologies with distinct levels of complexity, various sample size and different rates of errors in the data. Among the main results, we show that the introduction of Suppes' constraints dramatically improve the inference accuracy, by reducing the solution space and providing a temporal ordering on the variables. We also report on trade-offs among different search techniques that can be efficiently employed in distinct experimental settings. This manuscript is an extended version of the paper "Structural Learning of Probabilistic Graphical Models of Cumulative Phenomena" presented at the 2018 International Conference on Computational Science.
△ Less
Submitted 23 October, 2018; v1 submitted 8 March, 2017;
originally announced March 2017.
-
Parallel Implementation of Efficient Search Schemes for the Inference of Cancer Progression Models
Authors:
Daniele Ramazzotti,
Marco S. Nobile,
Paolo Cazzaniga,
Giancarlo Mauri,
Marco Antoniotti
Abstract:
The emergence and development of cancer is a consequence of the accumulation over time of genomic mutations involving a specific set of genes, which provides the cancer clones with a functional selective advantage. In this work, we model the order of accumulation of such mutations during the progression, which eventually leads to the disease, by means of probabilistic graphic models, i.e., Bayesia…
▽ More
The emergence and development of cancer is a consequence of the accumulation over time of genomic mutations involving a specific set of genes, which provides the cancer clones with a functional selective advantage. In this work, we model the order of accumulation of such mutations during the progression, which eventually leads to the disease, by means of probabilistic graphic models, i.e., Bayesian Networks (BNs). We investigate how to perform the task of learning the structure of such BNs, according to experimental evidence, adopting a global optimization meta-heuristics. In particular, in this work we rely on Genetic Algorithms, and to strongly reduce the execution time of the inference -- which can also involve multiple repetitions to collect statistically significant assessments of the data -- we distribute the calculations using both multi-threading and a multi-node architecture. The results show that our approach is characterized by good accuracy and specificity; we also demonstrate its feasibility, thanks to a 84x reduction of the overall execution time with respect to a traditional sequential implementation.
△ Less
Submitted 8 March, 2017;
originally announced March 2017.
-
Modeling cumulative biological phenomena with Suppes-Bayes Causal Networks
Authors:
Daniele Ramazzotti,
Alex Graudenzi,
Giulio Caravagna,
Marco Antoniotti
Abstract:
Several diseases related to cell proliferation are characterized by the accumulation of somatic DNA changes, with respect to wildtype conditions. Cancer and HIV are two common examples of such diseases, where the mutational load in the cancerous/viral population increases over time. In these cases, selective pressures are often observed along with competition, cooperation and parasitism among dist…
▽ More
Several diseases related to cell proliferation are characterized by the accumulation of somatic DNA changes, with respect to wildtype conditions. Cancer and HIV are two common examples of such diseases, where the mutational load in the cancerous/viral population increases over time. In these cases, selective pressures are often observed along with competition, cooperation and parasitism among distinct cellular clones. Recently, we presented a mathematical framework to model these phenomena, based on a combination of Bayesian inference and Suppes' theory of probabilistic causation, depicted in graphical structures dubbed Suppes-Bayes Causal Networks (SBCNs). SBCNs are generative probabilistic graphical models that recapitulate the potential ordering of accumulation of such DNA changes during the progression of the disease. Such models can be inferred from data by exploiting likelihood-based model-selection strategies with regularization. In this paper we discuss the theoretical foundations of our approach and we investigate in depth the influence on the model-selection task of: (i) the poset based on Suppes' theory and (ii) different regularization strategies. Furthermore, we provide an example of application of our framework to HIV genetic data highlighting the valuable insights provided by the inferred.
△ Less
Submitted 4 July, 2018; v1 submitted 25 February, 2016;
originally announced February 2016.
-
CLAZY: Lazy Calling for Common Lisp
Authors:
Marco Antoniotti
Abstract:
This document contains a description of a Common Lisp extension that allows a programmer to write functional programs that use "normal order" evaluation, as in "non-strict" languages like Haskell. The extension is relatively straightforward, and it appears to be the first one such that is integrated in the overall Common Lisp framework.
This document contains a description of a Common Lisp extension that allows a programmer to write functional programs that use "normal order" evaluation, as in "non-strict" languages like Haskell. The extension is relatively straightforward, and it appears to be the first one such that is integrated in the overall Common Lisp framework.
△ Less
Submitted 3 December, 2014;
originally announced December 2014.
-
Analysis of the spatial and dynamical properties of a multiscale model of intestinal crypts
Authors:
Giulio Caravagna,
Alex Graudenzi,
Marco Antoniotti,
Giovanni de Matteis
Abstract:
The preliminary analyses on a multiscale model of intestinal crypt dynamics are here presented. The model combines a morphological model, based on the Cellular Potts Model (CPM), and a gene regulatory network model, based on Noisy Random Boolean Networks (NRBNs). Simulations suggest that the stochastic differentiation process is itself sufficient to ensure the general homeostasis in the asymptot…
▽ More
The preliminary analyses on a multiscale model of intestinal crypt dynamics are here presented. The model combines a morphological model, based on the Cellular Potts Model (CPM), and a gene regulatory network model, based on Noisy Random Boolean Networks (NRBNs). Simulations suggest that the stochastic differentiation process is itself sufficient to ensure the general homeostasis in the asymptotic states, as proven by several measures.
△ Less
Submitted 29 September, 2013;
originally announced September 2013.
-
A Model of Colonic Crypts using SBML Spatial
Authors:
Daniele Ramazzotti,
Carlo Maj,
Marco Antoniotti
Abstract:
The Spatial Processes package enables an explicit definition of a spatial environment on top of the normal dynamic modeling SBML capabilities. The possibility of an explicit representation of spatial dynamics increases the representation power of SBML. In this work we used those new SBML features to define an extensive model of colonic crypts composed of the main cellular types (from stem cells to…
▽ More
The Spatial Processes package enables an explicit definition of a spatial environment on top of the normal dynamic modeling SBML capabilities. The possibility of an explicit representation of spatial dynamics increases the representation power of SBML. In this work we used those new SBML features to define an extensive model of colonic crypts composed of the main cellular types (from stem cells to fully differentiated cells), alongside their spatial dynamics.
△ Less
Submitted 29 September, 2013;
originally announced September 2013.
-
Proceedings Wivace 2013 - Italian Workshop on Artificial Life and Evolutionary Computation
Authors:
Alex Graudenzi,
Giulio Caravagna,
Giancarlo Mauri,
Marco Antoniotti
Abstract:
The Wivace 2013 Electronic Proceedings in Theoretical Computer Science (EPTCS) contain some selected long and short articles accepted for the presentation at Wivace 2013 - Italian Workshop on Artificial Life and Evolutionary Computation, which was held at the University of Milan-Bicocca, Milan, on the 1st and 2nd of July, 2013.
The Wivace 2013 Electronic Proceedings in Theoretical Computer Science (EPTCS) contain some selected long and short articles accepted for the presentation at Wivace 2013 - Italian Workshop on Artificial Life and Evolutionary Computation, which was held at the University of Milan-Bicocca, Milan, on the 1st and 2nd of July, 2013.
△ Less
Submitted 27 September, 2013;
originally announced September 2013.
-
Effects of delayed immune-response in tumor immune-system interplay
Authors:
Giulio Caravagna,
Alex Graudenzi,
Marco Antoniotti,
Giancarlo Mauri,
Alberto d'Onofrio
Abstract:
Tumors constitute a wide family of diseases kinetically characterized by the co-presence of multiple spatio-temporal scales. So, tumor cells ecologically interplay with other kind of cells, e.g. endothelial cells or immune system effectors, producing and exchanging various chemical signals. As such, tumor growth is an ideal object of hybrid modeling where discrete stochastic processes model age…
▽ More
Tumors constitute a wide family of diseases kinetically characterized by the co-presence of multiple spatio-temporal scales. So, tumor cells ecologically interplay with other kind of cells, e.g. endothelial cells or immune system effectors, producing and exchanging various chemical signals. As such, tumor growth is an ideal object of hybrid modeling where discrete stochastic processes model agents at low concentrations, and mean-field equations model chemical signals. In previous works we proposed a hybrid version of the well-known Panetta-Kirschner mean-field model of tumor cells, effector cells and Interleukin-2. Our hybrid model suggested -at variance of the inferences from its original formulation- that immune surveillance, i.e. tumor elimination by the immune system, may occur through a sort of side-effect of large stochastic oscillations. However, that model did not account that, due to both chemical transportation and cellular differentiation/division, the tumor-induced recruitment of immune effectors is not instantaneous but, instead, it exhibits a lag period. To capture this, we here integrate a mean-field equation for Interleukins-2 with a bi-dimensional delayed stochastic process describing such delayed interplay. An algorithm to realize trajectories of the underlying stochastic process is obtained by coupling the Piecewise Deterministic Markov process (for the hybrid part) with a Generalized Semi-Markovian clock structure (to account for delays). We (i) relate tumor mass growth with delays via simulations and via parametric sensitivity analysis techniques, (ii) we quantitatively determine probabilistic eradication times, and (iii) we prove, in the oscillatory regime, the existence of a heuristic stochastic bifurcation resulting in delay-induced tumor eradication, which is neither predicted by the mean-field nor by the hybrid non-delayed models.
△ Less
Submitted 19 August, 2012;
originally announced August 2012.
