Showing 1–2 of 2 results for author: Sampe, J

Triggerflow: Trigger-based Orchestration of Serverless Workflows

Authors: Aitor Arjona, Pedro García-López, Josep Sampé, Aleksander Slominski, Lionel Villard

Abstract: As more applications are being moved to the Cloud thanks to serverless computing, it is increasingly necessary to support the native life cycle execution of those applications in the data center. But existing cloud orchestration systems either focus on short-running workflows (like IBM Composer or Amazon Step Functions Express Workflows) or impose considerable overheads for synchronizing massively… ▽ More As more applications are being moved to the Cloud thanks to serverless computing, it is increasingly necessary to support the native life cycle execution of those applications in the data center. But existing cloud orchestration systems either focus on short-running workflows (like IBM Composer or Amazon Step Functions Express Workflows) or impose considerable overheads for synchronizing massively parallel jobs (Azure Durable Functions, Amazon Step Functions). None of them are open systems enabling extensible interception and optimization of custom workflows. We present Triggerflow: an extensible Trigger-based Orchestration architecture for serverless workflows. We demonstrate that Triggerflow is a novel serverless building block capable of constructing different reactive orchestrators (State Machines, Directed Acyclic Graphs, Workflow as code, Federated Learning orchestrator). We also validate that it can support high-volume event processing workloads, auto-scale on demand with scale down to zero when not used, and transparently guarantee fault tolerance and efficient resource usage when orchestrating long running scientific workflows. △ Less

Submitted 22 June, 2021; v1 submitted 1 June, 2021; originally announced June 2021.

Comments: 17 pages, 17 figures, preprint submitted to Future Generation Computer Systems. arXiv admin note: substantial text overlap with arXiv:2006.08654

Journal ref: Future Generation Computer Systems, Volume 124, November 2021, Pages 215-229

Triggerflow: Trigger-based Orchestration of Serverless Workflows

Authors: Pedro García-López, Aitor Arjona, Josep Sampe, Aleksander Slominski, Lionel Villard

Abstract: As more applications are being moved to the Cloud thanks to serverless computing, it is increasingly necessary to support native life cycle execution of those applications in the data center. But existing systems either focus on short-running workflows (like IBM Composer or Amazon Express Workflows) or impose considerable overheads for synchronizing massively parallel jobs (Azure Durable Functions… ▽ More As more applications are being moved to the Cloud thanks to serverless computing, it is increasingly necessary to support native life cycle execution of those applications in the data center. But existing systems either focus on short-running workflows (like IBM Composer or Amazon Express Workflows) or impose considerable overheads for synchronizing massively parallel jobs (Azure Durable Functions, Amazon Step Functions, Google Cloud Composer). None of them are open systems enabling extensible interception and optimization of custom workflows. We present Triggerflow: an extensible Trigger-based Orchestration architecture for serverless workflows built on top of Knative Eventing and Kubernetes technologies. We demonstrate that Triggerflow is a novel serverless building block capable of constructing different reactive schedulers (State Machines, Directed Acyclic Graphs, Workflow as code). We also validate that it can support high-volume event processing workloads, auto-scale on demand and transparently optimize scientific workflows. △ Less

Submitted 17 June, 2020; v1 submitted 15 June, 2020; originally announced June 2020.

Comments: The 14th ACM International Conference on Distributed and Event-based Systems (DEBS 2020)