Distributed, Parallel, and Cluster Computing

Authors and titles for June 2024

[1] arXiv:2406.00158 [pdf, other]

Title: Distributed Ranges: A Model for Distributed Data Structures, Algorithms, and Views

Benjamin Brock, Robert Cohn, Suyash Bakshi, Tuomas Karna, Jeongnim Kim, Mateusz Nowak, Łukasz Ślusarczyk, Kacper Stefanski, Timothy G. Mattson

Comments: To appear in ACM International Conference on Supercomputing (ICS) 2024

Journal-ref: In Proceedings of the 38th ACM International Conference on Supercomputing (ICS 2024) 236-246

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[2] arXiv:2406.00181 [pdf, html, other]

Title: Wait or Not to Wait: Evaluating Trade-Offs between Speed and Precision in Blockchain-based Federated Aggregation

Huong Nguyen, Tri Nguyen, Lauri Lovén, Susanna Pirttikangas

Comments: Accepted at Workshop on Engineering techniques for Distributed Computing Continuum Systems 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[3] arXiv:2406.00277 [pdf, html, other]

Title: Impact Conflict Detection of IoT Services in Multi-resident Smart Homes

Dipankar Chaki, Athman Bouguettaya, Abdallah Lakhdari

Comments: 11 pages, 6 figures, accepted and to be published in the proceedings of IEEE International Conference on Web Services (ICWS 2024)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[4] arXiv:2406.00752 [pdf, html, other]

Title: Blockchain-aided wireless federated learning: Resource allocation and client scheduling

Jun Li, Weiwei Zhang, Kang Wei, Guangji Chen, Feng Shu, Wen Chen, Shi Jin

Comments: 14 pages, 4 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[5] arXiv:2406.01047 [pdf, html, other]

Title: An Advanced Reinforcement Learning Framework for Online Scheduling of Deferrable Workloads in Cloud Computing

Hang Dong, Liwen Zhu, Zhao Shan, Bo Qiao, Fangkai Yang, Si Qin, Chuan Luo, Qingwei Lin, Yuwen Yang, Gurpreet Virdi, Saravan Rajmohan, Dongmei Zhang, Thomas Moscibroda

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[6] arXiv:2406.01146 [pdf, html, other]

Title: Formal Definition and Implementation of Reproducibility Tenets for Computational Workflows

Nicholas J. Pritchard, Andreas Wicenec

Comments: 21 pages, 16 figures, 11 tables. Accepted for publication with Future Generation Computing Systems

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[7] arXiv:2406.01201 [pdf, html, other]

Title: Structures and Techniques for Streaming Dynamic Graph Processing on Decentralized Message-Driven Systems

Bibrak Qamar Chandio, Maciej Brodowicz, Thomas Sterling

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[8] arXiv:2406.01374 [pdf, html, other]

Title: sAirflow: Adopting Serverless in a Legacy Workflow Scheduler

Filip Mikina, Pawel Zuk, Krzysztof Rzadca

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[9] arXiv:2406.01409 [pdf, html, other]

Title: Performance comparison of Dask and Apache Spark on HPC systems for Neuroimaging

Mathieu Dugré, Valérie Hayot-Sasson, Tristan Glatard

Comments: 16 pages, 10 figures, 2 tables

Journal-ref: Concurrency and Computation: Practice and Experience (2023) 35(21):e7635

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[10] arXiv:2406.01566 [pdf, html, other]

Title: Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow

Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak

Comments: ASPLOS 2025

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL); Machine Learning (cs.LG)

[11] arXiv:2406.01601 [pdf, html, other]

Title: Backpropagation-Free Multi-modal On-Device Model Adaptation via Cloud-Device Collaboration

Wei Ji, Li Li, Zheqi Lv, Wenqiao Zhang, Mengze Li, Zhen Wan, Wenqiang Lei, Roger Zimmermann

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[12] arXiv:2406.01739 [pdf, html, other]

Title: A Surprisingly Simple Method for Distributed Euclidean-Minimum Spanning Tree / Single Linkage Dendrogram Construction from High Dimensional Embeddings via Distance Decomposition

Richard Lettich

Comments: 2 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computational Geometry (cs.CG); Data Structures and Algorithms (cs.DS)

[13] arXiv:2406.01774 [pdf, html, other]

Title: Efficient Data Distribution Estimation for Accelerated Federated Learning

Yuanli Wang, Lei Huang

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[14] arXiv:2406.02216 [pdf, html, other]

Title: NordIQuEst: the Nordic-Estonian Quantum Computing e-Infrastructure Quest

Costantino Carugno, Jake Muff, Mikael P. Johansson, Sven Karlsson, Alberto Lanzanova

Comments: 15 pages, 2 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Quantum Physics (quant-ph)

[15] arXiv:2406.02252 [pdf, html, other]

Title: Exploring the Efficiency of Renewable Energy-based Modular Data Centers at Scale

Jinghan Sun, Zibo Gong, Anup Agarwal, Shadi Noghabi, Ranveer Chandra, Marc Snir, Jian Huang

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[16] arXiv:2406.02803 [pdf, html, other]

Title: DRust: Language-Guided Distributed Shared Memory with Fine Granularity, Full Transparency, and Ultra Efficiency

Haoran Ma, Yifan Qiao, Shi Liu, Shan Yu, Yuanjiang Ni, Qingda Lu, Jiesheng Wu, Yiying Zhang, Miryung Kim, Harry Xu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[17] arXiv:2406.03169 [pdf, other]

Title: Brief Announcement: Distributed Unconstrained Local Search for Multilevel Graph Partitioning

Peter Sanders, Daniel Seemaier

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[18] arXiv:2406.03285 [pdf, other]

Title: Efficient Data-Parallel Continual Learning with Asynchronous Distributed Rehearsal Buffers

Thomas Bouvier (KerData), Bogdan Nicolae (ANL), Hugo Chaugier (KerData), Alexandru Costan (KerData), Ian Foster (ANL), Gabriel Antoniu (KerData)

Comments: 2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), May 2024, Philadelphia (PA), United States

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[19] arXiv:2406.03488 [pdf, html, other]

Title: Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training

Ao Sun, Weilin Zhao, Xu Han, Cheng Yang, Xinrong Zhang, Zhiyuan Liu, Chuan Shi, Maosong Sun

Comments: 12 pages, 4 figures, 6 tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[20] arXiv:2406.03739 [pdf, html, other]

Title: Prioritized-MVBA: A New Approach to Design an Optimal Asynchronous Byzantine Agreement Protocol

Nasit S Sony, Xianzhong Ding, Mukesh Singhal

Comments: 23 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[21] arXiv:2406.03762 [pdf, html, other]

Title: CORTEX: Large-Scale Brain Simulator Utilizing Indegree Sub-Graph Decomposition on Fugaku Supercomputer

Tianxiang Lyu, Mitsuhisa Sato, Shigeki Aoki, Ryutaro Himeno, Zhe Sun

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Neurons and Cognition (q-bio.NC)

[22] arXiv:2406.03868 [pdf, html, other]

Title: PALM: A Efficient Performance Simulator for Tiled Accelerators with Large-scale Model Training

Jiahao Fang, Huizheng Wang, Qize Yang, Dehao Kong, Xu Dai, Jinyi Deng, Yang Hu, Shouyi Yin

Comments: 11 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[23] arXiv:2406.04210 [pdf, html, other]

Title: Gaining Cross-Platform Parallelism for HAL's Molecular Dynamics Package using SYCL

Viktor Skoblin, Felix Höfling, Steffen Christgau

Comments: 29th PARS-Workshop 2023, accepted for publication

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET); Computational Physics (physics.comp-ph)

[24] arXiv:2406.04480 [pdf, html, other]

Title: Everywhere & Nowhere: Envisioning a Computing Continuum for Science

Manish Parashar

Comments: This paper is based on the author's IEEE Sidney Fernbach award presentation at SC23, The International Conference for High Performance Computing, Networking Storage and Analysis, Denver, CO, USA, November 2023. It has been submitted for publication to IEEE Computing in Science and Engineering

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computers and Society (cs.CY)

[25] arXiv:2406.04497 [pdf, html, other]

Title: Consensus Through Knot Discovery in Asynchronous Dynamic Networks

Rachel Bricker, Mikhail Nesterenko, Gokarna Sharma

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[26] arXiv:2406.04594 [pdf, html, other]

Title: Boosting Large-scale Parallel Training Efficiency with C4: A Communication-Driven Approach

Jianbo Dong, Bin Luo, Jun Zhang, Pengcheng Zhang, Fei Feng, Yikai Zhu, Ang Liu, Zian Chen, Yi Shi, Hairong Jiao, Gang Lu, Yu Guan, Ennan Zhai, Wencong Xiao, Hanyu Zhao, Man Yuan, Siran Yang, Xiang Li, Jiamang Wang, Rui Men, Jianwei Zhang, Huang Zhong, Dennis Cai, Yuan Xie, Binzhang Fu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[27] arXiv:2406.04747 [pdf, html, other]

Title: Approximated Coded Computing: Towards Fast, Private and Secure Distributed Machine Learning

Houming Qiu, Kun Zhu, Nguyen Cong Luong, Dusit Niyato

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[28] arXiv:2406.04785 [pdf, html, other]

Title: Enabling Efficient Batch Serving for LMaaS via Generation Length Prediction

Ke Cheng, Wen Hu, Zhi Wang, Peng Du, Jianguo Li, Sheng Zhang

Comments: 12 pages, 14 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[29] arXiv:2406.05221 [pdf, html, other]

Title: GCAPS: GPU Context-Aware Preemptive Priority-based Scheduling for Real-Time Tasks

Yidi Wang, Cong Liu, Daniel Wong, Hyoseung Kim

Comments: Accepted by ECRTS 2024. arXiv admin note: substantial text overlap with arXiv:2401.16529

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[30] arXiv:2406.05490 [pdf, html, other]

Title: Beatnik: A Novel Global Communication Mini-Application

Jason A. Stewart, Patrick G. Bridges

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[31] arXiv:2406.05546 [pdf, html, other]

Title: Training Through Failure: Effects of Data Consistency in Parallel Machine Learning Training

Ray Cao, Sherry Luo, Steve Gan, Sujeeth Jinesh

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[32] arXiv:2406.05568 [pdf, other]

Title: SAMM: Sharded Automated Market Maker

Hongyin Chen, Amit Vaisman, Ittay Eyal

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Cryptography and Security (cs.CR)

[33] arXiv:2406.05577 [pdf, html, other]

Title: Flexible Multi-Dimensional FFTs for Plane Wave Density Functional Theory Codes

Doru Thom Popovici, Mauro del Ben, Osni Marques, Andrew Canning

Comments: 17 pages, 9 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Mathematical Software (cs.MS)

[34] arXiv:2406.05594 [pdf, html, other]

Title: Understanding GPU Triggering APIs for MPI+X Communication

Patrick G. Bridges, Anthony Skjellum, Evan D. Suggs, Derek Schafer, Purushotham V. Bangalore

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[35] arXiv:2406.05858 [pdf, html, other]

Title: Comments on "Federated Learning with Differential Privacy: Algorithms and Performance Analysis"

Mahtab Talaei, Iman Izadi

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Cryptography and Security (cs.CR); Performance (cs.PF)

[36] arXiv:2406.05904 [pdf, html, other]

Title: Aegis: Tethering a Blockchain with Primary-Chain Stake

Yogev Bar-On, Roi Bar-Zur, Omer Ben-Porat, Nimrod Cohen, Ittay Eyal, Matan Sitbon

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Cryptography and Security (cs.CR)

[37] arXiv:2406.05962 [pdf, html, other]

Title: Data Caching for Enterprise-Grade Petabyte-Scale OLAP

Chunxu Tang, Bin Fan, Jing Zhao, Chen Liang, Yi Wang, Beinan Wang, Ziyue Qiu, Lu Qiu, Bowen Ding, Shouzhuo Sun, Saiguang Che, Jiaming Mai, Shouwei Chen, Yu Zhu, Jianjian Xie, Yutian (James)Sun, Yao Li, Yangjun Zhang, Ke Wang, Mingmin Chen

Comments: Accepted to the USENIX Annual Technical Conference (USENIX ATC) 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Databases (cs.DB)

[38] arXiv:2406.06318 [pdf, other]

Title: Should my Blockchain Learn to Drive? A Study of Hyperledger Fabric

Jeeta Ann Chacko, Ruben Mayer, Hans-Arno Jacobsen

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Cryptography and Security (cs.CR)

[39] arXiv:2406.06799 [pdf, html, other]

Title: LLM-dCache: Improving Tool-Augmented LLMs with GPT-Driven Localized Data Caching

Simranjit Singh, Michael Fore, Andreas Karatzas, Chaehong Lee, Yanan Jian, Longfei Shangguan, Fuxun Yu, Iraklis Anagnostopoulos, Dimitrios Stamoulis

Comments: ICECS 2024 Camera-Ready

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL)

[40] arXiv:2406.06900 [pdf, html, other]

Title: SmartPQ: An Adaptive Concurrent Priority Queue for NUMA Architectures

Christina Giannoula, Foteini Strati, Dimitrios Siakavaras, Georgios Goumas, Nectarios Koziris

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[41] arXiv:2406.06955 [pdf, html, other]

Title: ElasticRec: A Microservice-based Model Serving Architecture Enabling Elastic Resource Scaling for Recommendation Models

Yujeong Choi, Jiin Kim, Minsoo Rhu

Journal-ref: 51th IEEE/ACM International Symposium on Computer Architecture (ISCA-51), 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[42] arXiv:2406.06975 [pdf, html, other]

Title: TraceMesh: Scalable and Streaming Sampling for Distributed Traces

Zhuangbin Chen, Zhihan Jiang, Yuxin Su, Michael R. Lyu, Zibin Zheng

Comments: Accepted by The 2024 IEEE 17th International Conference on Cloud Computing (CLOUD)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Software Engineering (cs.SE)

[43] arXiv:2406.06995 [pdf, html, other]

Title: HPC Alongside User-space Kubernetes

Vanessa Sochat, David Fox, Daniel Milroy

Comments: 12 pages, 9 figures, 2 tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[44] arXiv:2406.07335 [pdf, html, other]

Title: Undecided State Dynamics with Stubborn Agents

Petra Berenbrink, Felix Biermeier, Christopher Hahn

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[45] arXiv:2406.07441 [pdf, html, other]

Title: GPU Accelerated Implicit Kinetic Meshfree Method based on Modified LU-SGS

Mayuri Verma, Anil Nemili, Nischay Ram Mamidi

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Numerical Analysis (math.NA)

[46] arXiv:2406.07553 [pdf, other]

Title: Inference Acceleration for Large Language Models on CPUs

Ditto PS, Jithin VG, Adarsh MS

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL)

[47] arXiv:2406.07925 [pdf, html, other]

Title: FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning

Jiaxing QI, Zhongzhi Luan, Shaohan Huang, Carol Fung, Hailong Yang, Depei Qian

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[48] arXiv:2406.07946 [pdf, other]

Title: Emergent Peer-to-Peer Multi-Hub Topology

Mohamed Amine Legheraba (NPA), Maria Potop-Butucaru (NPA), Sébastien Tixeuil (NPA, IUF), Serge Fdida (NPA)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[49] arXiv:2406.08115 [pdf, html, other]

Title: Resource Allocation and Workload Scheduling for Large-Scale Distributed Deep Learning: A Survey

Feng Liang, Zhen Zhang, Haifeng Lu, Chengming Li, Victor C. M. Leung, Yanyi Guo, Xiping Hu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[50] arXiv:2406.08334 [pdf, html, other]

Title: ProTrain: Efficient LLM Training via Memory-Aware Techniques

Hanmei Yang, Jin Zhou, Yao Fu, Xiaoqun Wang, Ramine Roane, Hui Guan, Tongping Liu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Performance (cs.PF)