Distributed, Parallel, and Cluster Computing

Authors and titles for November 2024

[1] arXiv:2411.00284 [pdf, html, other]

Title: SimpleFSDP: Simpler Fully Sharded Data Parallel with torch.compile

Ruisi Zhang, Tianyu Liu, Will Feng, Andrew Gu, Sanket Purandare, Wanchao Liang, Francisco Massa

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[2] arXiv:2411.00558 [pdf, html, other]

Title: 3-Slot-Finality Protocol for Ethereum

Francesco D'Amato, Roberto Saltini, Thanh-Hai Tran, Luca Zanolini

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[3] arXiv:2411.00643 [pdf, html, other]

Title: Transforming Agriculture: Exploring Diverse Practices and Technological Innovations

Ramakant Kumar

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[4] arXiv:2411.00761 [pdf, html, other]

Title: LCP: Enhancing Scientific Data Management with Lossy Compression for Particles

Longtao Zhang, Ruoyu Li, Congrong Ren, Sheng Di, Jinyang Liu, Jiajun Huang, Robert Underwood, Pascal Grosset, Dingwen Tao, Xin Liang, Hanqi Guo, Franck Capello, Kai Zhao

Comments: Accepted by SIGMOD'25

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Databases (cs.DB)

[5] arXiv:2411.00815 [pdf, html, other]

Title: Exploiting long vectors with a CFD code: a co-design show case

Marc Blancafort, Roger Ferrer, Guillaume Houzeaux, Marta Garcia-Gasulla, Filippo Mantovani

Comments: Main track paper, presented at IPDPS 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR); Performance (cs.PF)

[6] arXiv:2411.00877 [pdf, other]

Title: Revisiting the Schedule Graph Generation for the Exact and Sustainable Analysis of Non-preemptive Scheduling

Marek Vlk, Marek Jaros, Zdenek Hanzalek

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[7] arXiv:2411.00907 [pdf, other]

Title: On the Impact of White-box Deployment Strategies for Edge AI on Latency and Model Performance

Jaskirat Singh, Bram Adams, Ahmed E. Hassan

Comments: In Approach Section, Pruning & Knowledge Distillation methods of Intel Neural Compressor don't reduce the model size & improve performance, respectively, unlike previous studies. There are issues exporting QAT models from PyTorch to ONNX, raising concerns about our latency results

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[8] arXiv:2411.01075 [pdf, other]

Title: Cephalo: Harnessing Heterogeneous GPU Clusters for Training Transformer Models

Runsheng Benson Guo, Utkarsh Anand, Arthur Chen, Khuzaima Daudjee

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[9] arXiv:2411.01090 [pdf, other]

Title: An Implementation and Experimental Comparison of Dynamic Ordered Sets

Jordan Malek

Comments: 6 Chapters, 71 Pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[10] arXiv:2411.01129 [pdf, html, other]

Title: Mewz: Lightweight Execution Environment for WebAssembly with High Isolation and Portability using Unikernels

Soichiro Ueda, Ai Nozaki, Daisuke Kotani, Yasuo Okabe

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Operating Systems (cs.OS)

[11] arXiv:2411.01137 [pdf, html, other]

Title: Data movement limits to frontier model training

Ege Erdil, David Schneider-Joseph

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[12] arXiv:2411.01142 [pdf, html, other]

Title: NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference

Xuanlin Jiang, Yang Zhou, Shiyi Cao, Ion Stoica, Minlan Yu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[13] arXiv:2411.01288 [pdf, html, other]

Title: Hexa-MoE: Efficient and Heterogeneous-aware Training for Mixture-of-Experts

Shuqing Luo, Jie Peng, Pingzhi Li, Hanrui Wang, Tianlong Chen

Comments: 17 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[14] arXiv:2411.01438 [pdf, html, other]

Title: SkyServe: Serving AI Models across Regions and Clouds with Spot Instances

Ziming Mao, Tian Xia, Zhanghao Wu, Wei-Lin Chiang, Tyler Griggs, Romil Bhardwaj, Zongheng Yang, Scott Shenker, Ion Stoica

Comments: EuroSys 25'

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[15] arXiv:2411.01460 [pdf, html, other]

Title: Mao: Machine learning approach for NUMA optimization in Warehouse Scale Computers

Yueji Liu, Jun Jin, Wenhui Shu, Shiyong Li, Yongzhan He

Comments: 10 pages, 13 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[16] arXiv:2411.01515 [pdf, html, other]

Title: Parallel Online Directed Acyclic Graph Exploration for Atlasing Soft-Matter Assembly Configuration Spaces

Rahul Prabhu, Amit Verma, Meera Sitharam

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[17] arXiv:2411.01579 [pdf, html, other]

Title: Flexible Coded Distributed Convolution Computing for Enhanced Fault Tolerance and Numerical Stability in Distributed CNNs

Shuo Tan, Rui Liu, XianLei Long, Kai Wan, Linqi Song, Yong Li

Comments: 14 pages, 6 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG)

[18] arXiv:2411.01611 [pdf, html, other]

Title: Stochastic Communication Avoidance for Recommendation Systems

Lutfi Eren Erdogan, Vijay Anand Raghava Kanakagiri, Kurt Keutzer, Zhen Dong

Journal-ref: Conference on Artificial Intelligence (IEEE CAI) 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[19] arXiv:2411.01738 [pdf, html, other]

Title: xDiT: an Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism

Jiarui Fang, Jinzhe Pan, Xibo Sun, Aoyu Li, Jiannan Wang

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[20] arXiv:2411.01783 [pdf, html, other]

Title: Context Parallelism for Scalable Million-Token Inference

Amy Yang, Jingyi Yang, Aya Ibrahim, Xinfeng Xie, Bangsheng Tang, Grigory Sizov, Jeremy Reizenstein, Jongsoo Park, Jianyu Huang

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[21] arXiv:2411.01791 [pdf, html, other]

Title: Minder: Faulty Machine Detection for Large-scale Distributed Model Training

Yangtao Deng, Xiang Shi, Zhuo Jiang, Xingjian Zhang, Lei Zhang, Zhang Zhang, Bo Li, Zuquan Song, Hang Zhu, Gaohong Liu, Fuliang Li, Shuguang Wang, Haibin Lin, Jianxi Ye, Minlan Yu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[22] arXiv:2411.01830 [pdf, html, other]

Title: FaaSTube: Optimizing GPU-oriented Data Transfer for Serverless Computing

Hao Wu, Junxiao Deng, Minchen Yu, Yue Yu, Yaochen Liu, Hao Fan, Song Wu, Wei Wang

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[23] arXiv:2411.02505 [pdf, other]

Title: Benchmarking Accuracy in an Emulated Memory Experiment

Tim Chan

Comments: 2+1 pages, 2 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Quantum Physics (quant-ph)

[24] arXiv:2411.02560 [pdf, html, other]

Title: Fast and Robust Information Spreading in the Noisy PULL Model

Niccolò D'Archivio, Amos Korman, Emanuele Natale, Robin Vacus

Comments: 41 pages, 1 figure

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[25] arXiv:2411.02581 [pdf, html, other]

Title: Configurable Non-uniform All-to-all Algorithms

Ke Fan, Jens Domke, Seydou Ba, Sidharth Kumar

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[26] arXiv:2411.02829 [pdf, html, other]

Title: CE-CoLLM: Efficient and Adaptive Large Language Models Through Cloud-Edge Collaboration

Hongpeng Jin, Yanzhao Wu

Comments: To appear in IEEE ICWS 2025

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[27] arXiv:2411.02868 [pdf, html, other]

Title: iAnomaly: A Toolkit for Generating Performance Anomaly Datasets in Edge-Cloud Integrated Computing Environments

Duneesha Fernando, Maria A. Rodriguez, Rajkumar Buyya

Comments: Accepted for publication at the 17th IEEE/ACM International Conference on Utility and Cloud Computing (UCC 2024)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[28] arXiv:2411.02945 [pdf, html, other]

Title: Instant Resonance: Dual Strategy Enhances the Data Consensus Success Rate of Blockchain Threshold Signature Oracles

Youquan Xian, Xueying Zeng, Chunpei Li, Dongcheng Li, Peng Wang, Peng Liu, Xianxian Li

Comments: Submitted to FGCS

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET)

[29] arXiv:2411.03240 [pdf, html, other]

Title: Distributed Quantum Advantage for Local Problems

Alkida Balliu, Sebastian Brandt, Xavier Coiteux-Roy, Francesco d'Amore, Massimo Equi, François Le Gall, Henrik Lievonen, Augusto Modanese, Dennis Olivetti, Marc-Olivier Renou, Jukka Suomela, Lucas Tendick, Isadora Veeren

Comments: 64 pages, 9 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computational Complexity (cs.CC); Quantum Physics (quant-ph)

[30] arXiv:2411.03376 [pdf, html, other]

Title: An Open API Architecture to Discover the Trustworthy Explanation of Cloud AI Services

Zerui Wang, Yan Liu, Jun Huang

Comments: Published in: IEEE Transactions on Cloud Computing ( Volume: 12, Issue: 2, April-June 2024)

Journal-ref: IEEE Transactions on Cloud Computing ( Volume: 12, Issue: 2, April-June 2024)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Networking and Internet Architecture (cs.NI)

[31] arXiv:2411.03519 [pdf, html, other]

Title: AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution

Zhiqiang Xie, Hao Kang, Ying Sheng, Tushar Krishna, Kayvon Fatahalian, Christos Kozyrakis

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multiagent Systems (cs.MA)

[32] arXiv:2411.03533 [pdf, html, other]

Title: Shared Memory-Aware Latency-Sensitive Message Aggregation for Fine-Grained Communication

Kavitha Chandrasekar, Laxmikant Kale

Comments: A shorter version of this paper has been accepted at IA^3 workshop at SC24

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[33] arXiv:2411.03645 [pdf, other]

Title: Exploiting Stragglers in Distributed Computing Systems with Task Grouping

Tharindu Adikari, Haider Al-Lawati, Jason Lam, Zhenhua Hu, Stark C. Draper

Comments: This paper has been accepted for publication in IEEE Transactions on Services Computing. The initial results presented in this paper appeared in the proceedings of the Allerton Conference on Communication, Control, and Computing in 2023

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[34] arXiv:2411.03892 [pdf, html, other]

Title: Two Sides of the Same Coin: Large-scale Measurements of Builder and Rollup after EIP-4844

Yue Huang, Shuzheng Wang, Yuming Huang, Jing Tang

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Cryptography and Security (cs.CR); Emerging Technologies (cs.ET)

[35] arXiv:2411.03902 [pdf, html, other]

Title: Almost Time-Optimal Loosely-Stabilizing Leader Election on Arbitrary Graphs Without Identifiers in Population Protocols

Haruki Kanaya, Ryota Eguchi, Taisho Sasada, Michiko Inoue

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[36] arXiv:2411.03999 [pdf, html, other]

Title: ParaGAN: A Scalable Distributed Training Framework for Generative Adversarial Networks

Ziji Shi, Jialin Li, Yang You

Comments: Accepted at ACM Symposium on Cloud Computing (SoCC) 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[37] arXiv:2411.04271 [pdf, html, other]

Title: OpenFLAME: Building a large scale federated localization and mapping service

Sagar Bharadwaj, Luke Wang, Michael Liang, Harrison Williams, Ivan Liang, Srinivasan Seshan, Anthony Rowe

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[38] arXiv:2411.04318 [pdf, html, other]

Title: Intersections of Web3 and AI -- View in 2024

David Hyland-Wood, Sandra Johnson

Comments: 20 pages, 6 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[39] arXiv:2411.04538 [pdf, html, other]

Title: Analysis of Blockchain Assisted Energy Sharing Algorithms with Realistic Data Across Microgrids

Abdulrezzak Zekiye, Ozan Sina Bankaoglu, Ouns Bouachir, Oznur Ozkasap, Moayad Aloqaily

Comments: 8 pages, 4 figures, and 3 tables. Accepted for publication in The Sixth International Conference on Blockchain Computing and Applications (BCCA 2024)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[40] arXiv:2411.04561 [pdf, html, other]

Title: Joint wireless and computing resource management with optimal slice selection in in-network-edge metaverse system

Sulaiman Muhammad Rashid, Ibrahim Aliyu, Abubakar Isah, Jihoon Lee, Sangwon Oh, Minsoo Hahn, Jinsul Kim

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)

[41] arXiv:2411.04593 [pdf, other]

Title: RainCloud: Decentralized Coordination and Communication in Heterogeneous IoT Swarms

Filip Loisel, Geri Zeqo, Andrea Morichetta, Anna Lackinger, Schahram Dustdar

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[42] arXiv:2411.04686 [pdf, html, other]

Title: Precision-Aware Iterative Algorithms Based on Group-Shared Exponents of Floating-Point Numbers

Jianhua Gao, Jiayuan Shen, Yuxiang Zhang, Weixing Ji, Hua Huang

Comments: 13 pages, 9 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Numerical Analysis (math.NA)

[43] arXiv:2411.05248 [pdf, other]

Title: Ten Pillars for Data Meshes

Robert L. Grossman, Ceilyn Boyd, Nhan Do, Danne C. Elbers, Michael S. Fitzsimons, Maryellen L. Giger, Anthony Juehne, Brienna Larrick, Jerry S. H. Lee, Dawei Lin, Michael Lukowski, James D. Myers, L. Philip Schumm, Aarti Venkat

Comments: 10 pages, 1 figure

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[44] arXiv:2411.05288 [pdf, html, other]

Title: Balancing Pipeline Parallelism with Vocabulary Parallelism

Man Tsung Yeung, Penghui Qi, Min Lin, Xinyi Wan

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[45] arXiv:2411.05309 [pdf, other]

Title: GPUVM: GPU-driven Unified Virtual Memory

Nurlan Nazaraliyev, Elaheh Sadredini, Nael Abu-Ghazaleh

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Operating Systems (cs.OS); Performance (cs.PF)

[46] arXiv:2411.05333 [pdf, html, other]

Title: Error-controlled Progressive Retrieval of Scientific Data under Derivable Quantities of Interest

Xuan Wu, Qian Gong, Jieyang Chen, Qing Liu, Norbert Podhorszki, Xin Liang, Scott Klasky

Comments: SC'24

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[47] arXiv:2411.05555 [pdf, html, other]

Title: AcceLLM: Accelerating LLM Inference using Redundancy for Load Balancing and Data Locality

Ilias Bournias, Lukas Cavigelli, Georgios Zacharopoulos

Comments: 10 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[48] arXiv:2411.06364 [pdf, html, other]

Title: EconoServe: Maximizing Multi-Resource Utilization with SLO Guarantees in LLM Serving

Haiying Shen, Tanmoy Sen

Comments: 14 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[49] arXiv:2411.06788 [pdf, html, other]

Title: Designing Local Distributed Mechanisms

Juho Hirvonen, Sara Ranjbaran

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computer Science and Game Theory (cs.GT)

[50] arXiv:2411.06895 [pdf, html, other]

Title: DynaShard: Secure and Adaptive Blockchain Sharding Protocol with Hybrid Consensus and Dynamic Shard Management

Ao Liu, Jing Chen, Kun He, Ruiying Du, Jiahua Xu, Cong Wu, Yebo Feng, Teng Li, Jianfeng Ma

Comments: 13 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[51] arXiv:2411.07011 [pdf, html, other]

Title: The Singular Optimality of Distributed Computation in LOCAL

Fabien Dufoulon, Gopal Pandurangan, Peter Robinson, Michele Scquizzato

Comments: Reduced abstract to fit arxiv requirements

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[52] arXiv:2411.07106 [pdf, html, other]

Title: Topological Characterization of Stabilizing Consensus

Ulrich Schmid, Stephan Felber, Hugo Rincon-Galeana

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); General Topology (math.GN)

[53] arXiv:2411.07444 [pdf, html, other]

Title: Input-Based Ensemble-Learning Method for Dynamic Memory Configuration of Serverless Computing Functions

Siddharth Agarwal, Maria A. Rodriguez, Rajkumar Buyya

Comments: 10 pages, 2 tables, 28 figures, accepted conference paper - UCC'24

Journal-ref: 17th IEEE/ACM International Conference on Utility and Cloud Computing (UCC 2024)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Systems and Control (eess.SY)

[54] arXiv:2411.07628 [pdf, html, other]

Title: A Framework for Carbon-aware Real-Time Workload Management in Clouds using Renewables-driven Cores

Tharindu B. Hewage, Shashikant Ilager, Maria A. Rodriguez, Rajkumar Buyya

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[55] arXiv:2411.07752 [pdf, html, other]

Title: ALANINE: A Novel Decentralized Personalized Federated Learning For Heterogeneous LEO Satellite Constellation

Liang Zhao, Shenglin Geng, Xiongyan Tang, Ammar Hawbani, Yunhe Sun, Lexi Xu, Daniele Tarchi

Comments: 14 pages, 8 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[56] arXiv:2411.08434 [pdf, html, other]

Title: Anonymous Self-Stabilising Localisation via Spatial Population Protocols

Leszek Gąsieniec, Łukasz Kuszner, Ehsan Latif, Ramviyas Parasuraman, Paul Spirakis, Grzegorz Stachowiak

Comments: Accepted as a brief announcement for SAND 2025

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[57] arXiv:2411.08446 [pdf, html, other]

Title: LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing

Xiaonan Nie, Qibin Liu, Fangcheng Fu, Shenhan Zhu, Xupeng Miao, Xiaoyang Li, Yang Zhang, Shouda Liu, Bin Cui

Comments: Accepted by NeurIPS 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[58] arXiv:2411.08448 [pdf, html, other]

Title: In Serverless, OS Scheduler Choice Costs Money: A Hybrid Scheduling Approach for Cheaper FaaS

Yuxuan Zhao, Weikang Weng, Rob van Nieuwpoort, Alexandru Uta

Comments: Accepted at Middleware 2024, author draft made available for timely dissemination

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[59] arXiv:2411.08914 [pdf, other]

Title: Future-Proofing IoT: Unleashing the Power of AWS Greengrass in Propelling Smart Devices to New Heights

Sahasra Kokkula, Ankit Vatsa, Savaridassan P

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[60] arXiv:2411.09473 [pdf, html, other]

Title: Enhancing Scalability and Performance in Influence Maximization with Optimized Parallel Processing

Hanjiang Wu, Huan Xu, Joongun Park, Jesmin Jahan Tithi, Fabio Checconi, Jordi Wolfson-Pou, Fabrizio Petrini, Tushar Krishna

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[61] arXiv:2411.09809 [pdf, html, other]

Title: Scalable Readability Evaluation for Graph Layouts: 2D Geometric Distributed Algorithms

Sanggeon Yun

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[62] arXiv:2411.09957 [pdf, html, other]

Title: Sublinear-time Collision Detection with a Polynomial Number of States in Population Protocols

Takumi Araya, Yuichi Sudo

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[63] arXiv:2411.09981 [pdf, html, other]

Title: SoK: Consensus for Fair Message Ordering

Zhuolun Li, Evangelos Pournaras

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[64] arXiv:2411.10003 [pdf, html, other]

Title: Pro-Prophet: A Systematic Load Balancing Method for Efficient Parallel Training of Large-scale MoE Models

Wei Wang, Zhiquan Lai, Shengwei Li, Weijie Liu, Keshi Ge, Ao Shen, Huayou Su, Dongsheng Li

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[65] arXiv:2411.10026 [pdf, html, other]

Title: SoK: DAG-based Consensus Protocols

Mayank Raikwar, Nikita Polyanskii, Sebastian Müller

Comments: This is a revised and updated version of the paper published in the proceedings of IEEE ICBC 2024. Comments are welcome

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[66] arXiv:2411.10143 [pdf, html, other]

Title: Cascaded Prediction and Asynchronous Execution of Iterative Algorithms on Heterogeneous Platforms

Jianhua Gao, Bingjie Liu, Yizhuo Wang, Weixing Ji, Hua Huang

Comments: 12 pages, 9 figures, 7 tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Mathematical Software (cs.MS)

[67] arXiv:2411.10249 [pdf, html, other]

Title: How the interplay between power concentration, competition, and propagation affects the resource efficiency of distributed ledgers

Paolo Barucca, Carlo Campajola, Jiahua Xu

Comments: 18 pages, 10 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI); Physics and Society (physics.soc-ph)

[68] arXiv:2411.10289 [pdf, html, other]

Title: Clock Synchronization Is Almost Impossible with Bounded Memory

Bernadette Charron-Bost, Louis Penet de Monterno

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[69] arXiv:2411.10290 [pdf, html, other]

Title: The ParClusterers Benchmark Suite (PCBS): A Fine-Grained Analysis of Scalable Graph Clustering

Shangdi Yu, Jessica Shi, Jamison Meindl, David Eisenstat, Xiaoen Ju, Sasan Tavakkol, Laxman Dhulipala, Jakub Łącki, Vahab Mirrokni, Julian Shun

Comments: This is a preliminary version of a paper that will appear at VLDB'25

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[70] arXiv:2411.10340 [pdf, other]

Title: Domain Adaptation-based Edge Computing for Cross-Conditions Fault Diagnosis

Yanzhi Wang, Chu Wang, Jinhong Wu, Ziyang Yu, Qi Zhou

Comments: 28 pages, 11 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)

[71] arXiv:2411.10532 [pdf, html, other]

Title: Breaking the mold: overcoming the time constraints of molecular dynamics on general-purpose hardware

Danny Perez, Aidan Thompson, Stan Moore, Tomas Oppelstrup, Ilya Sharapov, Kylee Santos, Amirali Sharifian, Delyan Z. Kalchev, Robert Schreiber, Scott Pakin, Edgar A. Leon, James H. Laros III, Michael James, Sivasankaran Rajamanickam

Journal-ref: Journal of Chemical Physics 2025, 162(7), 072501

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Materials Science (cond-mat.mtrl-sci); Computational Physics (physics.comp-ph)

[72] arXiv:2411.10815 [pdf, html, other]

Title: Collaborative UAVs Multi-task Video Processing Optimization Based on Enhanced Distributed Actor-Critic Networks

Ziqi Rong, Qiushi Zheng, Zhishu Shen, Xiaolong Li, Tiehua Zhang, Zheng Lei, Jiong Jin

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[73] arXiv:2411.11217 [pdf, html, other]

Title: MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs

Shiyi Cao, Shu Liu, Tyler Griggs, Peter Schafhalter, Xiaoxuan Liu, Ying Sheng, Joseph E. Gonzalez, Matei Zaharia, Ion Stoica

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[74] arXiv:2411.11468 [pdf, html, other]

Title: $ν$-LPA: Fast GPU-based Label Propagation Algorithm (LPA) for Community Detection

Subhajit Sahu

Comments: 10 pages, 6 figures, 1 table

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI)

[75] arXiv:2411.11493 [pdf, html, other]

Title: LSRAM: A Lightweight Autoscaling and SLO Resource Allocation Framework for Microservices Based on Gradient Descent

Kan Hu, Minxian Xu, Kejiang Ye, Chengzhong Xu

Comments: 22 pages

Journal-ref: Software: Practice and Experience 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[76] arXiv:2411.11540 [pdf, html, other]

Title: The Jevons Paradox In Cloud Computing: A Thermodynamics Perspective

Prateek Sharma

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[77] arXiv:2411.11547 [pdf, html, other]

Title: gpuPairHMM: High-speed Pair-HMM Forward Algorithm for DNA Variant Calling on GPUs

Bertil Schmidt, Felix Kallenborn, Alexander Wichmann, Alejandro Chacon, Christian Hundt

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Genomics (q-bio.GN)

[78] arXiv:2411.11560 [pdf, html, other]

Title: Topology-aware Preemptive Scheduling for Co-located LLM Workloads

Ping Zhang, Lei Su, Jinjie Yang, Xin Chen

Comments: 17 Pages, 11 Figures, 5 Tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[79] arXiv:2411.11665 [pdf, html, other]

Title: Hash & Adjust: Competitive Demand-Aware Consistent Hashing

Arash Pourdamghani, Chen Avin, Robert Sama, Maryam Shiran, Stefan Schmid

Comments: This paper has been accepted to International Conference on Principles of Distributed Systems (OPODIS 2024)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[80] arXiv:2411.11718 [pdf, html, other]

Title: Distributed Maximum Flow in Planar Graphs

Yaseen Abd-Elhaleem (1), Michal Dory (1), Merav Parter (2), Oren Weimann (1) ((1) University of Haifa, (2) Weizmann Institute of Science)

Comments: 64 pages, to appear in proceedings of PODC 2025, appeared in DISC 2024 as a BA

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[81] arXiv:2411.12161 [pdf, other]

Title: Adaptive Cache Management for Complex Storage Systems Using CNN-LSTM-Based Spatiotemporal Prediction

Xiaoye Wang, Xuan Li, Linji Wang, Tingyi Ruan, Pochun Li

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[82] arXiv:2411.12303 [pdf, other]

Title: An Integrated (Crop Model, Cloud and Big Data Analytic) Framework to support Agriculture Activity Monitoring System

Shamim Akhter, Kiyoshi Honda, Kento Aida, Amor V.M. Ines

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[83] arXiv:2411.12456 [pdf, html, other]

Title: Ichnos: A Carbon Footprint Estimator for Scientific Workflows

Kathleen West, Magnus Reid, Yehia Elkhatib, Lauritz Thamsen

Comments: GitHub Repository: this https URL

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[84] arXiv:2411.12559 [pdf, other]

Title: Emulating a computing grid in a local environment for feature evaluation

Jananga Kalawana, Malith Dilshan, Kaveesha Dinamidu, Kalana Wijethunga, Maksim Stortvedt, Indika Perera

Comments: 16 pages 4 figures 2 tables Computer Science & Information Technology (CS & IT) ISSN : 2231 - 5403 Volume 14, Number 22, November 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[85] arXiv:2411.13039 [pdf, html, other]

Title: TrustMesh: A Blockchain-Enabled Trusted Distributed Computing Framework for Open Heterogeneous IoT Environments

Murtaza Rangwala, Rajkumar Buyya

Comments: 11 pages, 6 figures | v2 Edits: Fixed incomplete sentence construction in Section VI.D | v3 Edits: Fixed formatting, added acknowledgement and other minor fixes

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[86] arXiv:2411.13121 [pdf, html, other]

Title: ReinFog: A DRL Empowered Framework for Resource Management in Edge and Cloud Computing Environments

Zhiyu Wang, Mohammad Goudarzi, Rajkumar Buyya

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[87] arXiv:2411.13239 [pdf, other]

Title: Transforming the Hybrid Cloud for Emerging AI Workloads

Deming Chen, Alaa Youssef, Ruchi Pendse, André Schleife, Bryan K. Clark, Hendrik Hamann, Jingrui He, Teodoro Laino, Lav Varshney, Yuxiong Wang, Avirup Sil, Reyhaneh Jabbarvand, Tianyin Xu, Volodymyr Kindratenko, Carlos Costa, Sarita Adve, Charith Mendis, Minjia Zhang, Santiago Núñez-Corrales, Raghu Ganti, Mudhakar Srivatsa, Nam Sung Kim, Josep Torrellas, Jian Huang, Seetharami Seelam, Klara Nahrstedt, Tarek Abdelzaher, Tamar Eilam, Huimin Zhao, Matteo Manica, Ravishankar Iyer, Martin Hirzel, Vikram Adve, Darko Marinov, Hubertus Franke, Hanghang Tong, Elizabeth Ainsworth, Han Zhao, Deepak Vasisht, Minh Do, Sahil Suneja, Fabio Oliveira, Giovanni Pacifici, Ruchir Puri, Priya Nagpurkar

Comments: 70 pages, 27 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Hardware Architecture (cs.AR); Emerging Technologies (cs.ET); Multiagent Systems (cs.MA)

[88] arXiv:2411.13334 [pdf, html, other]

Title: Sublinear-Time Sampling of Spanning Trees in the Congested Clique

Sriram V. Pemmaraju, Sourya Roy, Joshua Z. Sobel

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[89] arXiv:2411.13377 [pdf, html, other]

Title: Distributed weak independent sets in hypergraphs: Upper and lower bounds

Duncan Adamson, Will Rosenbaum, Paul G. Spirakis

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[90] arXiv:2411.13441 [pdf, html, other]

Title: A Case Study of API Design for Interoperability and Security of the Internet of Things

Dongha Kim, Chanhee Lee, Hokeun Kim

Comments: To appear in Proceedings of the 2nd EAI International Conference on Security and Privacy in Cyber-Physical Systems and Smart Vehicles (SmartSP 2024)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)

[91] arXiv:2411.13532 [pdf, other]

Title: A Distributed-memory Tridiagonal Solver Based on a Specialised Data Structure Optimised for CPU and GPU Architectures

Semih Akkurt, Sébastien Lemaire, Paul Bartholomew, Sylvain Laizet

Comments: 42 pages, 13 figures, 6 tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computational Physics (physics.comp-ph)

[92] arXiv:2411.13809 [pdf, other]

Title: DCSim: Computing and Networking Integration based Container Scheduling Simulator for Data Centers

Jinlong Hu, Zhizhe Rao, Xingchen Liu, Lihao Deng, Shoubin Dong

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[93] arXiv:2411.13861 [pdf, html, other]

Title: Asynchronous Federated Learning Using Outdated Local Updates Over TDMA Channel

Jaeyoung Song, Jun-Pyo Hong

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[94] arXiv:2411.13979 [pdf, html, other]

Title: FedRAV: Hierarchically Federated Region-Learning for Traffic Object Classification of Autonomous Vehicles

Yijun Zhai, Pengzhan Zhou, Yuepeng He, Fang Qu, Zhida Qin, Xianlong Jiao, Guiyan Liu, Songtao Guo

Comments: 8 pages, 4 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[95] arXiv:2411.14070 [pdf, html, other]

Title: Towards Adaptive Asynchronous Federated Learning for Human Activity Recognition

Rastko Gajanin, Anastasiya Danilenka, Andrea Morichetta, Stefan Nastic

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[96] arXiv:2411.14420 [pdf, other]

Title: Aggregating Funnels for Faster Fetch&Add and Queues

Younghun Roh, Yuanhao Wei, Eric Ruppert, Panagiota Fatourou, Siddhartha Jayanti, Julian Shun

Comments: This is the full version of the paper appearing in PPoPP 2025

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[97] arXiv:2411.14458 [pdf, html, other]

Title: Improving training time and GPU utilization in geo-distributed language model training

Palak (Microsoft Research India), Rohan Gandhi (Microsoft Research India), Karan Tandon (Microsoft Research India), Debopam Bhattacherjee (Microsoft Research India), Venkata N. Padmanabhan (Microsoft Research India)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[98] arXiv:2411.14590 [pdf, html, other]

Title: LLOR: Automated Repair of OpenMP Programs

Utpal Bora, Saurabh Joshi, Gautam Muduganti, Ramakrishna Upadrasta

Comments: 23 pages, 1 algorithm, 2 figures, 26th International Conference on Verification Model Checking and Abstract Interpretation (VMCAI 2025)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Software Engineering (cs.SE)

[99] arXiv:2411.14887 [pdf, html, other]

Title: OMP4Py: a pure Python implementation of OpenMP

César Piñeiro, Juan C. Pichel

Comments: 15 pages, 14 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Programming Languages (cs.PL)

[100] arXiv:2411.15381 [pdf, html, other]

Title: DiffServe: Efficiently Serving Text-to-Image Diffusion Models with Query-Aware Model Scaling

Sohaib Ahmad, Qizheng Yang, Haoliang Wang, Ramesh K. Sitaraman, Hui Guan

Comments: 16 pages, 9 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)