Showing 1–1 of 1 results for author: Chafin, T K

Scaling a Variant Calling Genomics Pipeline with FaaS

Authors: Aitor Arjona, Arnau Gabriel-Atienza, Sara Lanuza-Orna, Xavier Roca-Canals, Ayman Bourramouss, Tyler K. Chafin, Lucio Marcello, Paolo Ribeca, Pedro García-López

Abstract: With the escalating complexity and volume of genomic data, the capacity of biology institutions' HPC faces limitations. While the Cloud presents a viable solution for short-term elasticity, its intricacies pose challenges for bioinformatics users. Alternatively, serverless computing allows for workload scalability with minimal developer burden. However, porting a scientific application to serverle… ▽ More With the escalating complexity and volume of genomic data, the capacity of biology institutions' HPC faces limitations. While the Cloud presents a viable solution for short-term elasticity, its intricacies pose challenges for bioinformatics users. Alternatively, serverless computing allows for workload scalability with minimal developer burden. However, porting a scientific application to serverless is not a straightforward process. In this article, we present a Variant Calling genomics pipeline migrated from single-node HPC to a serverless architecture. We describe the inherent challenges of this approach and the engineering efforts required to achieve scalability. We contribute by open-sourcing the pipeline for future systems research and as a scalable user-friendly tool for the bioinformatics community. △ Less

Submitted 12 December, 2023; originally announced December 2023.

Comments: 6 pages, published at 9th International Workshop on Serverless Computing (WoSC '23), December 11-15, 2023, Bologna, Italy

Journal ref: WoSC 23 Proceedings of the 9th International Workshop on Serverless Computing, December 2023, Pages 59 64