-
A directed continuous-wave search from neutron stars in binary systems with the five-vector resampling technique
Authors:
Francesco Amicucci,
Paola Leaci,
Pia Astone,
Sabrina D'Antonio,
Stefano Dal Pra,
Matteo Di Giovanni,
Luca D'Onofrio,
Federico Muciaccia,
Cristiano Palomba,
Lorenzo Pierini,
Akshat Singhal
Abstract:
Continuous gravitational-wave signals (CWs), which are typically emitted by rapidly rotating neutron stars with non-axisymmetric deformations, represent particularly intriguing targets for the Advanced LIGO-Virgo-KAGRA detectors. These detectors operate within sensitivity bands that encompass more than half of the known pulsars in our galaxy existing in binary systems, which are the targeted sourc…
▽ More
Continuous gravitational-wave signals (CWs), which are typically emitted by rapidly rotating neutron stars with non-axisymmetric deformations, represent particularly intriguing targets for the Advanced LIGO-Virgo-KAGRA detectors. These detectors operate within sensitivity bands that encompass more than half of the known pulsars in our galaxy existing in binary systems, which are the targeted sources of this paper. However, the detection of these faint signals is especially challenged by the Doppler modulation due to the source's orbital motion, typically described by five Keplerian parameters, which must be determined with high precision to effectively detect the signal. This modulation spreads the signal across multiple frequency bins, resulting in a notable reduction of signal-to-noise ratio and potentially hindering signal detection. To overcome this issue, a robust five-vector resampling data-analysis algorithm has been developed to conduct thorough directed/narrowband CW searches at an affordable computational cost. We employ this methodology for the first time to search for CWs from Scorpius X-1, using publicly available data from the third observing run of the Advanced LIGO-Virgo-KAGRA detectors. No statistically significant CW signals can be claimed. Hence, we proceeded setting 95% confidence-level upper limits in selected frequency bands and orbital parameter ranges, while also evaluating overall sensitivity.
△ Less
Submitted 25 May, 2025;
originally announced May 2025.
-
A directed continuous-wave search from Scorpius X-1 with the five-vector resampling technique
Authors:
Francesco Amicucci,
Paola Leaci,
Pia Astone,
Sabrina D'Antonio,
Stefano Dal Pra,
Matteo Di Giovanni,
Luca D'Onofrio,
Federico Muciaccia,
Cristiano Palomba,
Lorenzo Pierini,
Akshat Singhal
Abstract:
Continuous gravitational-wave signals (CWs), which are typically emitted by rapidly rotating neutron stars with non-axisymmetric deformations, represent particularly intriguing targets for the Advanced LIGO-Virgo-KAGRA detectors. These detectors operate within sensitivity bands that encompass more than half of the known pulsars in our galaxy existing in binary systems (i.e., over 417 pulsars), whi…
▽ More
Continuous gravitational-wave signals (CWs), which are typically emitted by rapidly rotating neutron stars with non-axisymmetric deformations, represent particularly intriguing targets for the Advanced LIGO-Virgo-KAGRA detectors. These detectors operate within sensitivity bands that encompass more than half of the known pulsars in our galaxy existing in binary systems (i.e., over 417 pulsars), which are the targeted sources of this paper. However, the detection of these faint signals is especially challenged by the Doppler modulation due to the source's orbital motion, typically described by five Keplerian parameters, which must be determined with high precision to effectively detect the signal. This modulation spreads the signal across multiple frequency bins, resulting in a notable reduction of signal-to-noise ratio and potentially hindering signal detection. To overcome this issue, a robust five-vector resampling data-analysis algorithm has been developed to conduct thorough directed/narrowband CW searches at an affordable computational cost. We employ this methodology for the first time to search for CWs from Scorpius X-1, using publicly available data from the third observing run of the Advanced LIGO-Virgo-KAGRA detectors. No statistically significant CW signals can be claimed. Hence, we proceeded setting 95% confidence-level upper limits in selected frequency bands and orbital parameter ranges, while also evaluating overall sensitivity.
△ Less
Submitted 10 March, 2025;
originally announced March 2025.
-
Supporting the development of Machine Learning for fundamental science in a federated Cloud with the AI_INFN platform
Authors:
Lucio Anderlini,
Matteo Barbetti,
Giulio Bianchini,
Diego Ciangottini,
Stefano Dal Pra,
Diego Michelotto,
Carmelo Pellegrino,
Rosa Petrini,
Alessandro Pascolini,
Daniele Spiga
Abstract:
Machine Learning (ML) is driving a revolution in the way scientists design, develop, and deploy data-intensive software. However, the adoption of ML presents new challenges for the computing infrastructure, particularly in terms of provisioning and orchestrating access to hardware accelerators for development, testing, and production. The INFN-funded project AI_INFN ("Artificial Intelligence at IN…
▽ More
Machine Learning (ML) is driving a revolution in the way scientists design, develop, and deploy data-intensive software. However, the adoption of ML presents new challenges for the computing infrastructure, particularly in terms of provisioning and orchestrating access to hardware accelerators for development, testing, and production. The INFN-funded project AI_INFN ("Artificial Intelligence at INFN") aims at fostering the adoption of ML techniques within INFN use cases by providing support on multiple aspects, including the provision of AI-tailored computing resources. It leverages cloud-native solutions in the context of INFN Cloud, to share hardware accelerators as effectively as possible, ensuring the diversity of the Institute's research activities is not compromised. In this contribution, we provide an update on the commissioning of a Kubernetes platform designed to ease the development of GPU-powered data analysis workflows and their scalability on heterogeneous, distributed computing resources, possibly federated as Virtual Kubelets with the interLink provider.
△ Less
Submitted 28 February, 2025;
originally announced February 2025.
-
Search for continuous gravitational waves from known pulsars in the first part of the fourth LIGO-Virgo-KAGRA observing run
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
A. G. Abac,
R. Abbott,
I. Abouelfettouh,
F. Acernese,
K. Ackley,
S. Adhicary,
N. Adhikari,
R. X. Adhikari,
V. K. Adkins,
D. Agarwal,
M. Agathos,
M. Aghaei Abchouyeh,
O. D. Aguiar,
I. Aguilar,
L. Aiello,
A. Ain,
P. Ajith,
T. Akutsu,
S. Albanesi,
R. A. Alfaidi,
A. Al-Jodah,
C. Alléné
, et al. (1794 additional authors not shown)
Abstract:
Continuous gravitational waves (CWs) emission from neutron stars carries information about their internal structure and equation of state, and it can provide tests of General Relativity. We present a search for CWs from a set of 45 known pulsars in the first part of the fourth LIGO--Virgo--KAGRA observing run, known as O4a. We conducted a targeted search for each pulsar using three independent ana…
▽ More
Continuous gravitational waves (CWs) emission from neutron stars carries information about their internal structure and equation of state, and it can provide tests of General Relativity. We present a search for CWs from a set of 45 known pulsars in the first part of the fourth LIGO--Virgo--KAGRA observing run, known as O4a. We conducted a targeted search for each pulsar using three independent analysis methods considering the single-harmonic and the dual-harmonic emission models. We find no evidence of a CW signal in O4a data for both models and set upper limits on the signal amplitude and on the ellipticity, which quantifies the asymmetry in the neutron star mass distribution. For the single-harmonic emission model, 29 targets have the upper limit on the amplitude below the theoretical spin-down limit. The lowest upper limit on the amplitude is $6.4\!\times\!10^{-27}$ for the young energetic pulsar J0537-6910, while the lowest constraint on the ellipticity is $8.8\!\times\!10^{-9}$ for the bright nearby millisecond pulsar J0437-4715. Additionally, for a subset of 16 targets we performed a narrowband search that is more robust regarding the emission model, with no evidence of a signal. We also found no evidence of non-standard polarizations as predicted by the Brans-Dicke theory.
△ Less
Submitted 2 January, 2025;
originally announced January 2025.
-
Doppler correlation-driven vetoes for the Frequency Hough analysis in continuous gravitational-wave searches
Authors:
Matteo Di Giovanni,
Paola Leaci,
Pia Astone,
Stefano Dal Pra,
Sabrina D'Antonio,
Luca D'Onofrio,
Sergio Frasca,
Federico Muciaccia,
Cristiano Palomba,
Lorenzo Pierini,
Francesco Safai Tehrani
Abstract:
We present an improved method for vetoing candidates of continuous gravitational-wave sources during all-sky searches utilizing the Frequency Hough pipeline. This approach leverages linear correlations between source parameters induced by the Earth Doppler effect, which can be effectively identified through the Hough Transform. Candidates that do not align with these patterns are considered spurio…
▽ More
We present an improved method for vetoing candidates of continuous gravitational-wave sources during all-sky searches utilizing the Frequency Hough pipeline. This approach leverages linear correlations between source parameters induced by the Earth Doppler effect, which can be effectively identified through the Hough Transform. Candidates that do not align with these patterns are considered spurious and can thus be vetoed, enhancing the depth and statistical significance of follow-up analyses. Additionally, we provide a comprehensive explanation of the method calibration, which intrinsically linked to the total duration of the observing run. On average, the procedure successfully vetoes $56\%$ of candidates. To assess the method performance, we conducted a Monte-Carlo simulation injecting fake continuous-wave signals into data from the third observing run of the LIGO detectors. This analysis allowed us to infer strain amplitude upper limits at a $90\%$ confidence level. We found that the optimal sensitivity is $h_0^{90\%} = 3.62^{+0.23}_{-0.22}\times 10^{-26}$ in the [128, 200] Hz band, which is within the most sensible frequency band of the LIGO detectors.
△ Less
Submitted 3 March, 2025; v1 submitted 25 October, 2024;
originally announced October 2024.
-
Search for gravitational waves emitted from SN 2023ixf
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
A. G. Abac,
R. Abbott,
I. Abouelfettouh,
F. Acernese,
K. Ackley,
S. Adhicary,
N. Adhikari,
R. X. Adhikari,
V. K. Adkins,
D. Agarwal,
M. Agathos,
M. Aghaei Abchouyeh,
O. D. Aguiar,
I. Aguilar,
L. Aiello,
A. Ain,
T. Akutsu,
S. Albanesi,
R. A. Alfaidi,
A. Al-Jodah,
C. Alléné,
A. Allocca
, et al. (1758 additional authors not shown)
Abstract:
We present the results of a search for gravitational-wave transients associated with core-collapse supernova SN 2023ixf, which was observed in the galaxy Messier 101 via optical emission on 2023 May 19th, during the LIGO-Virgo-KAGRA 15th Engineering Run. We define a five-day on-source window during which an accompanying gravitational-wave signal may have occurred. No gravitational waves have been…
▽ More
We present the results of a search for gravitational-wave transients associated with core-collapse supernova SN 2023ixf, which was observed in the galaxy Messier 101 via optical emission on 2023 May 19th, during the LIGO-Virgo-KAGRA 15th Engineering Run. We define a five-day on-source window during which an accompanying gravitational-wave signal may have occurred. No gravitational waves have been identified in data when at least two gravitational-wave observatories were operating, which covered $\sim 14\%$ of this five-day window. We report the search detection efficiency for various possible gravitational-wave emission models. Considering the distance to M101 (6.7 Mpc), we derive constraints on the gravitational-wave emission mechanism of core-collapse supernovae across a broad frequency spectrum, ranging from 50 Hz to 2 kHz where we assume the gravitational-wave emission occurred when coincident data are available in the on-source window. Considering an ellipsoid model for a rotating proto-neutron star, our search is sensitive to gravitational-wave energy $1 \times 10^{-4} M_{\odot} c^2$ and luminosity $2.6 \times 10^{-4} M_{\odot} c^2/s$ for a source emitting at 82 Hz. These constraints are around an order of magnitude more stringent than those obtained so far with gravitational-wave data. The constraint on the ellipticity of the proto-neutron star that is formed is as low as 1.08, at frequencies above 1200 Hz, surpassing past results.
△ Less
Submitted 11 March, 2025; v1 submitted 21 October, 2024;
originally announced October 2024.
-
A search using GEO600 for gravitational waves coincident with fast radio bursts from SGR 1935+2154
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
A. G. Abac,
R. Abbott,
I. Abouelfettouh,
F. Acernese,
K. Ackley,
S. Adhicary,
N. Adhikari,
R. X. Adhikari,
V. K. Adkins,
D. Agarwal,
M. Agathos,
M. Aghaei Abchouyeh,
O. D. Aguiar,
I. Aguilar,
L. Aiello,
A. Ain,
P. Ajith,
T. Akutsu,
S. Albanesi,
R. A. Alfaidi,
A. Al-Jodah,
C. Alléné
, et al. (1758 additional authors not shown)
Abstract:
The magnetar SGR 1935+2154 is the only known Galactic source of fast radio bursts (FRBs). FRBs from SGR 1935+2154 were first detected by CHIME/FRB and STARE2 in 2020 April, after the conclusion of the LIGO, Virgo, and KAGRA Collaborations' O3 observing run. Here we analyze four periods of gravitational wave (GW) data from the GEO600 detector coincident with four periods of FRB activity detected by…
▽ More
The magnetar SGR 1935+2154 is the only known Galactic source of fast radio bursts (FRBs). FRBs from SGR 1935+2154 were first detected by CHIME/FRB and STARE2 in 2020 April, after the conclusion of the LIGO, Virgo, and KAGRA Collaborations' O3 observing run. Here we analyze four periods of gravitational wave (GW) data from the GEO600 detector coincident with four periods of FRB activity detected by CHIME/FRB, as well as X-ray glitches and X-ray bursts detected by NICER and NuSTAR close to the time of one of the FRBs. We do not detect any significant GW emission from any of the events. Instead, using a short-duration GW search (for bursts $\leq$ 1 s) we derive 50\% (90\%) upper limits of $10^{48}$ ($10^{49}$) erg for GWs at 300 Hz and $10^{49}$ ($10^{50}$) erg at 2 kHz, and constrain the GW-to-radio energy ratio to $\leq 10^{14} - 10^{16}$. We also derive upper limits from a long-duration search for bursts with durations between 1 and 10 s. These represent the strictest upper limits on concurrent GW emission from FRBs.
△ Less
Submitted 21 May, 2025; v1 submitted 11 October, 2024;
originally announced October 2024.
-
Neural network method to search for long transient gravitational waves
Authors:
Francesca Attadio,
Leonardo Ricca,
Marco Serra,
Cristiano Palomba,
Pia Astone,
Simone Dall'Osso,
Stefano Dal Pra,
Sabrina D'Antonio,
Matteo Di Giovanni,
Luca D'Onofrio,
Paola Leaci,
Federico Muciaccia,
Lorenzo Pierini,
Francesco Safai Tehrani
Abstract:
We present a new method to search for long transient gravitational waves signals, like those expected from fast spinning newborn magnetars, in interferometric detector data. Standard search techniques are computationally unfeasible (matched filtering) or very demanding (sub-optimal semi-coherent methods). We explored a different approach by means of machine learning paradigms, to define a fast and…
▽ More
We present a new method to search for long transient gravitational waves signals, like those expected from fast spinning newborn magnetars, in interferometric detector data. Standard search techniques are computationally unfeasible (matched filtering) or very demanding (sub-optimal semi-coherent methods). We explored a different approach by means of machine learning paradigms, to define a fast and inexpensive procedure. We used convolutional neural networks to develop a classifier that is able to discriminate between the presence or the absence of a signal. To complement the classification and enhance its effectiveness, we also developed a denoiser. We studied the performance of both networks with simulated colored noise, according to the design noise curve of LIGO interferometers. We show that the combination of the two models is crucial to increase the chance of detection. Indeed, as we decreased the signal initial amplitude (from $10^{-22}$ down to $10^{-23}$) the classification task became more difficult. In particular, we could not correctly tag signals with an initial amplitude of $2 \times 10^{-23}$ without using the denoiser. By studying the performance of the combined networks, we found a good compromise between the search false alarm rate (2$\%$) and efficiency (90$\%$) for a single interferometer. In addition, we demonstrated that our method is robust with respect to changes in the power law describing the time evolution of the signal frequency. Our results highlight the computationally low cost of this method to generate triggers for long transient signals. The study carried out in this work lays the foundations for further improvements, with the purpose of developing a pipeline able to perform systematic searches of long transient signals.
△ Less
Submitted 23 January, 2025; v1 submitted 2 July, 2024;
originally announced July 2024.
-
Two sides of the same coin: the F-statistic and the 5-vector method
Authors:
L. D'Onofrio,
P. Astone,
S. Dal Pra,
S. D'Antonio,
M. Di Giovanni,
R. De Rosa,
P. Leaci,
S. Mastrogiovanni,
L. Mirasola,
F. Muciaccia,
C. Palomba,
L. Pierini
Abstract:
This work explores the relationship between two data-analysis methods used in the search for continuous gravitational waves in LIGO-Virgo-KAGRA data: the $\mathcal{F}$-statistic and the 5-vector method. We show that the 5-vector method can be derived from a maximum likelihood framework similar to the $\mathcal{F}$-statistic. Our analysis demonstrates that the two methods are statistically equivale…
▽ More
This work explores the relationship between two data-analysis methods used in the search for continuous gravitational waves in LIGO-Virgo-KAGRA data: the $\mathcal{F}$-statistic and the 5-vector method. We show that the 5-vector method can be derived from a maximum likelihood framework similar to the $\mathcal{F}$-statistic. Our analysis demonstrates that the two methods are statistically equivalent, providing the same detection probability for a given false alarm rate. We extend this comparison to multiple detectors, highlighting differences from the standard approach that simply combines 5-vectors from each detector. In our maximum likelihood approach, each 5-vector is weighted by the observation time and sensitivity of its respective detector, resulting in efficient estimators and analytical distributions for the detection statistic. Additionally, we present the analytical computation of sensitivity for different searches, expressed in terms of the minimum detectable amplitude.
△ Less
Submitted 13 June, 2024;
originally announced June 2024.
-
Observation of Gravitational Waves from the Coalescence of a $2.5\text{-}4.5~M_\odot$ Compact Object and a Neutron Star
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
A. G. Abac,
R. Abbott,
I. Abouelfettouh,
F. Acernese,
K. Ackley,
S. Adhicary,
N. Adhikari,
R. X. Adhikari,
V. K. Adkins,
D. Agarwal,
M. Agathos,
M. Aghaei Abchouyeh,
O. D. Aguiar,
I. Aguilar,
L. Aiello,
A. Ain,
P. Ajith,
S. Akçay,
T. Akutsu,
S. Albanesi,
R. A. Alfaidi,
A. Al-Jodah
, et al. (1771 additional authors not shown)
Abstract:
We report the observation of a coalescing compact binary with component masses $2.5\text{-}4.5~M_\odot$ and $1.2\text{-}2.0~M_\odot$ (all measurements quoted at the 90% credible level). The gravitational-wave signal GW230529_181500 was observed during the fourth observing run of the LIGO-Virgo-KAGRA detector network on 2023 May 29 by the LIGO Livingston Observatory. The primary component of the so…
▽ More
We report the observation of a coalescing compact binary with component masses $2.5\text{-}4.5~M_\odot$ and $1.2\text{-}2.0~M_\odot$ (all measurements quoted at the 90% credible level). The gravitational-wave signal GW230529_181500 was observed during the fourth observing run of the LIGO-Virgo-KAGRA detector network on 2023 May 29 by the LIGO Livingston Observatory. The primary component of the source has a mass less than $5~M_\odot$ at 99% credibility. We cannot definitively determine from gravitational-wave data alone whether either component of the source is a neutron star or a black hole. However, given existing estimates of the maximum neutron star mass, we find the most probable interpretation of the source to be the coalescence of a neutron star with a black hole that has a mass between the most massive neutron stars and the least massive black holes observed in the Galaxy. We provisionally estimate a merger rate density of $55^{+127}_{-47}~\text{Gpc}^{-3}\,\text{yr}^{-1}$ for compact binary coalescences with properties similar to the source of GW230529_181500; assuming that the source is a neutron star-black hole merger, GW230529_181500-like sources constitute about 60% of the total merger rate inferred for neutron star-black hole coalescences. The discovery of this system implies an increase in the expected rate of neutron star-black hole mergers with electromagnetic counterparts and provides further evidence for compact objects existing within the purported lower mass gap.
△ Less
Submitted 26 July, 2024; v1 submitted 5 April, 2024;
originally announced April 2024.
-
A semi-coherent generalization of the 5-vector method to search for continuous gravitational waves
Authors:
S. D'Antonio,
C. Palomba,
P. Astone,
S. Dall'Osso,
S. Dal Pra,
S. Frasca,
P. Leaci,
F. Muciaccia,
O. J. Piccinni,
L. Pierini,
M. Serra
Abstract:
The emission of continuous gravitational waves (CWs), with duration much longer than the typical data taking runs, is expected from several sources, notably spinning neutron stars, asymmetric with respect to their rotation axis and more exotic sources, like ultra-light scalar boson clouds formed around Kerr black holes and sub-solar mass primordial binary black holes. Unless the signal time evolut…
▽ More
The emission of continuous gravitational waves (CWs), with duration much longer than the typical data taking runs, is expected from several sources, notably spinning neutron stars, asymmetric with respect to their rotation axis and more exotic sources, like ultra-light scalar boson clouds formed around Kerr black holes and sub-solar mass primordial binary black holes. Unless the signal time evolution is well predicted and its relevant parameters accurately known, the search for CWs is typically based on semi-coherent methods, where the full data set is divided in shorter chunks of given duration, which are properly processed, and then incoherently combined. In this paper we present a semi-coherent method, in which the so-called \textit{5-vector} statistics is computed for the various data segments and then summed after the removal of the Earth Doppler modulation and signal intrinsic spin-down. The method can work with segment duration of several days, thanks to a double stage procedure in which an initial rough correction of the Doppler and spin-down is followed by a refined step in which the residual variations are removed. This method can be efficiently applied for directed searches, where the source position is known to a good level of accuracy, and in the candidate follow-up stage of wide-parameter space searches.
△ Less
Submitted 10 November, 2023;
originally announced November 2023.
-
Extension of the INFN Tier-1 on a HPC system
Authors:
Tommaso Boccali,
Stefano Dal Pra,
Daniele Spiga,
Diego Ciangottini,
Stefano Zani,
Concezio Bozzi,
Alessandro De Salvo,
Andrea Valassi,
Francesco Noferini,
Luca dell Agnello,
Federico Stagni,
Alessandra Doria,
Daniele Bonacorsi
Abstract:
The INFN Tier-1 located at CNAF in Bologna (Italy) is a center of the WLCG e-Infrastructure, supporting the 4 major LHC collaborations and more than 30 other INFN-related experiments. After multiple tests towards elastic expansion of CNAF compute power via Cloud resources (provided by Azure, Aruba and in the framework of the HNSciCloud project), and building on the experience gained with the produ…
▽ More
The INFN Tier-1 located at CNAF in Bologna (Italy) is a center of the WLCG e-Infrastructure, supporting the 4 major LHC collaborations and more than 30 other INFN-related experiments. After multiple tests towards elastic expansion of CNAF compute power via Cloud resources (provided by Azure, Aruba and in the framework of the HNSciCloud project), and building on the experience gained with the production quality extension of the Tier-1 farm on remote owned sites, the CNAF team, in collaboration with experts from the ALICE, ATLAS, CMS, and LHCb experiments, has been working to put in production a solution of an integrated HTC+HPC system with the PRACE CINECA center, located nearby Bologna. Such extension will be implemented on the Marconi A2 partition, equipped with Intel Knights Landing (KNL) processors. A number of technical challenges were faced and solved in order to successfully run on low RAM nodes, as well as to overcome the closed environment (network, access, software distribution, ... ) that HPC systems deploy with respect to standard GRID sites. We show preliminary results from a large scale integration effort, using resources secured via the successful PRACE grant N. 2018194658, for 30 million KNL core hours.
△ Less
Submitted 25 June, 2020;
originally announced June 2020.
-
INDIGO-DataCloud:A data and computing platform to facilitate seamless access to e-infrastructures
Authors:
INDIGO-DataCloud Collaboration,
:,
Davide Salomoni,
Isabel Campos,
Luciano Gaido,
Jesus Marco de Lucas,
Peter Solagna,
Jorge Gomes,
Ludek Matyska,
Patrick Fuhrman,
Marcus Hardt,
Giacinto Donvito,
Lukasz Dutka,
Marcin Plociennik,
Roberto Barbera,
Ignacio Blanquer,
Andrea Ceccanti,
Mario David,
Cristina Duma,
Alvaro López-García,
Germán Moltó,
Pablo Orviz,
Zdenek Sustr,
Matthew Viljoen,
Fernando Aguilar
, et al. (40 additional authors not shown)
Abstract:
This paper describes the achievements of the H2020 project INDIGO-DataCloud. The project has provided e-infrastructures with tools, applications and cloud framework enhancements to manage the demanding requirements of scientific communities, either locally or through enhanced interfaces. The middleware developed allows to federate hybrid resources, to easily write, port and run scientific applicat…
▽ More
This paper describes the achievements of the H2020 project INDIGO-DataCloud. The project has provided e-infrastructures with tools, applications and cloud framework enhancements to manage the demanding requirements of scientific communities, either locally or through enhanced interfaces. The middleware developed allows to federate hybrid resources, to easily write, port and run scientific applications to the cloud. In particular, we have extended existing PaaS (Platform as a Service) solutions, allowing public and private e-infrastructures, including those provided by EGI, EUDAT, and Helix Nebula, to integrate their existing services and make them available through AAI services compliant with GEANT interfederation policies, thus guaranteeing transparency and trust in the provisioning of such services. Our middleware facilitates the execution of applications using containers on Cloud and Grid based infrastructures, as well as on HPC clusters. Our developments are freely downloadable as open source components, and are already being integrated into many scientific applications.
△ Less
Submitted 5 February, 2019; v1 submitted 6 November, 2017;
originally announced November 2017.
-
Improved Cloud resource allocation: how INDIGO-DataCloud is overcoming the current limitations in Cloud schedulers
Authors:
Alvaro Lopez Garcia,
Lisa Zangrando,
Massimo Sgaravatto,
Vincent Llorens,
Sara Vallero,
Valentina Zaccolo,
Stefano Bagnasco,
Sonia Taneja,
Stefano Dal Pra,
Davide Salomoni,
Giacinto Donvito
Abstract:
Performing efficient resource provisioning is a fundamental aspect for any resource provider. Local Resource Management Systems (LRMS) have been used in data centers for decades in order to obtain the best usage of the resources, providing their fair usage and partitioning for the users. In contrast, current cloud schedulers are normally based on the immediate allocation of resources on a first-co…
▽ More
Performing efficient resource provisioning is a fundamental aspect for any resource provider. Local Resource Management Systems (LRMS) have been used in data centers for decades in order to obtain the best usage of the resources, providing their fair usage and partitioning for the users. In contrast, current cloud schedulers are normally based on the immediate allocation of resources on a first-come, first-served basis, meaning that a request will fail if there are no resources (e.g. OpenStack) or it will be trivially queued ordered by entry time (e.g. OpenNebula). Moreover, these scheduling strategies are based on a static partitioning of the resources, meaning that existing quotas cannot be exceeded, even if there are idle resources allocated to other projects. This is a consequence of the fact that cloud instances are not associated with a maximum execution time and leads to a situation where the resources are under-utilized. These facts have been identified by the INDIGO-DataCloud project as being too simplistic for accommodating scientific workloads in an efficient way, leading to an underutilization of the resources, a non desirable situation in scientific data centers. In this work, we will present the work done in the scheduling area during the first year of the INDIGO project and the foreseen evolutions.
△ Less
Submitted 20 July, 2017;
originally announced July 2017.
