-
DAMEWARE - Data Mining & Exploration Web Application Resource
Authors:
Massimo Brescia,
Stefano Cavuoti,
Francesco Esposito,
Michelangelo Fiore,
Mauro Garofalo,
Marisa Guglielmo,
Giuseppe Longo,
Francesco Manna,
Alfonso Nocella,
Civita Vellucci
Abstract:
Astronomy is undergoing through a methodological revolution triggered by an unprecedented wealth of complex and accurate data. DAMEWARE (DAta Mining & Exploration Web Application and REsource) is a general purpose, Web-based, Virtual Observatory compliant, distributed data mining framework specialized in massive data sets exploration with machine learning methods. We present the DAMEWARE (DAta Min…
▽ More
Astronomy is undergoing through a methodological revolution triggered by an unprecedented wealth of complex and accurate data. DAMEWARE (DAta Mining & Exploration Web Application and REsource) is a general purpose, Web-based, Virtual Observatory compliant, distributed data mining framework specialized in massive data sets exploration with machine learning methods. We present the DAMEWARE (DAta Mining & Exploration Web Application REsource) which allows the scientific community to perform data mining and exploratory experiments on massive data sets, by using a simple web browser. DAMEWARE offers several tools which can be seen as working environments where to choose data analysis functionalities such as clustering, classification, regression, feature extraction etc., together with models and algorithms.
△ Less
Submitted 16 March, 2016; v1 submitted 2 March, 2016;
originally announced March 2016.
-
DAMEWARE: A web cyberinfrastructure for astrophysical data mining
Authors:
Massimo Brescia,
Stefano Cavuoti,
Giuseppe Longo,
Alfonso Nocella,
Mauro Garofalo,
Francesco Manna,
Francesco Esposito,
Giovanni Albano,
Marisa Guglielmo,
Giovanni D'Angelo,
Alessandro Di Guido,
George S. Djorgovski,
Ciro Donalek,
Ashish A. Mahabal,
Matthew J. Graham,
Michelangelo Fiore,
Raffaele D'Abrusco
Abstract:
Astronomy is undergoing through a methodological revolution triggered by an unprecedented wealth of complex and accurate data. The new panchromatic, synoptic sky surveys require advanced tools for discovering patterns and trends hidden behind data which are both complex and of high dimensionality. We present DAMEWARE (DAta Mining & Exploration Web Application REsource): a general purpose, web-base…
▽ More
Astronomy is undergoing through a methodological revolution triggered by an unprecedented wealth of complex and accurate data. The new panchromatic, synoptic sky surveys require advanced tools for discovering patterns and trends hidden behind data which are both complex and of high dimensionality. We present DAMEWARE (DAta Mining & Exploration Web Application REsource): a general purpose, web-based, distributed data mining environment developed for the exploration of large datasets, and finely tuned for astronomical applications. By means of graphical user interfaces, it allows the user to perform classification, regression or clustering tasks with machine learning methods. Salient features of DAMEWARE include its capability to work on large datasets with minimal human intervention, and to deal with a wide variety of real problems such as the classification of globular clusters in the galaxy NGC1399, the evaluation of photometric redshifts and, finally, the identification of candidate Active Galactic Nuclei in multiband photometric surveys. In all these applications, DAMEWARE allowed to achieve better results than those attained with more traditional methods. With the aim of providing potential users with all needed information, in this paper we briefly describe the technological background of DAMEWARE, give a short introduction to some relevant aspects of data mining, followed by a summary of some science cases and, finally, we provide a detailed description of a template use case.
△ Less
Submitted 13 June, 2014;
originally announced June 2014.
-
The DAME/VO-Neural Infrastructure: an Integrated Data Mining System Support for the Science Community
Authors:
M. Brescia,
A. Corazza,
S. Cavuoti,
G. d'Angelo,
R. D'Abrusco,
C. Donalek,
S. G. Djorgovski,
N. Deniskina,
M. Fiore,
M. Garofalo,
O. Laurino,
G. Longo A. Mahabal,
F. Manna,
A. Nocella,
B. Skordovski
Abstract:
Astronomical data are gathered through a very large number of heterogeneous techniques and stored in very diversified and often incompatible data repositories. Moreover in the e-science environment, it is needed to integrate services across distributed, heterogeneous, dynamic "virtual organizations" formed by different resources within a single enterprise and/or external resource sharing and servi…
▽ More
Astronomical data are gathered through a very large number of heterogeneous techniques and stored in very diversified and often incompatible data repositories. Moreover in the e-science environment, it is needed to integrate services across distributed, heterogeneous, dynamic "virtual organizations" formed by different resources within a single enterprise and/or external resource sharing and service provider relationships. The DAME/VONeural project, run jointly by the University Federico II, INAF (National Institute of Astrophysics) Astronomical Observatories of Napoli and the California Institute of Technology, aims at creating a single, sustainable, distributed e-infrastructure for data mining and exploration in massive data sets, to be offered to the astronomical (but not only) community as a web application. The framework makes use of distributed computing environments (e.g. S.Co.P.E.) and matches the international IVOA standards and requirements. The integration process is technically challenging due to the need of achieving a specific quality of service when running on top of different native platforms. In these terms, the result of the DAME/VO-Neural project effort will be a service-oriented architecture, obtained by using appropriate standards and incorporating Grid paradigms and restful Web services frameworks where needed, that will have as main target the integration of interdisciplinary distributed systems within and across organizational domains.
△ Less
Submitted 4 December, 2011;
originally announced December 2011.
-
DAME: A Web Oriented Infrastructure for Scientific Data Mining & Exploration
Authors:
Massimo Brescia,
Giuseppe Longo,
George S. Djorgovski,
Stefano Cavuoti,
Raffaele D'Abrusco,
Ciro Donalek,
Alessandro Di Guido,
Michelangelo Fiore,
Mauro Garofalo,
Omar Laurino,
Ashish Mahabal,
Francesco Manna,
Alfonso Nocella,
Giovanni d'Angelo,
Maurizio Paolillo
Abstract:
Nowadays, many scientific areas share the same need of being able to deal with massive and distributed datasets and to perform on them complex knowledge extraction tasks. This simple consideration is behind the international efforts to build virtual organizations such as, for instance, the Virtual Observatory (VObs). DAME (DAta Mining & Exploration) is an innovative, general purpose, Web-based, VO…
▽ More
Nowadays, many scientific areas share the same need of being able to deal with massive and distributed datasets and to perform on them complex knowledge extraction tasks. This simple consideration is behind the international efforts to build virtual organizations such as, for instance, the Virtual Observatory (VObs). DAME (DAta Mining & Exploration) is an innovative, general purpose, Web-based, VObs compliant, distributed data mining infrastructure specialized in Massive Data Sets exploration with machine learning methods. Initially fine tuned to deal with astronomical data only, DAME has evolved in a general purpose platform which has found applications also in other domains of human endeavor. We present the products and a short outline of a science case, together with a detailed description of main features available in the beta release of the web application now released.
△ Less
Submitted 7 December, 2010; v1 submitted 23 October, 2010;
originally announced October 2010.
