Distributed, Parallel, and Cluster Computing

Authors and titles for February 2024

[101] arXiv:2402.17216 [pdf, other]

Title: Application of Machine Learning Optimization in Cloud Computing Resource Scheduling and Management

Yifan Zhang, Bo Liu, Yulu Gong, Jiaxin Huang, Jingyu Xu, Weixiang Wan

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[102] arXiv:2402.17337 [pdf, html, other]

Title: Massive parallelization and performance enhancement of an immersed boundary method based unsteady flow solver

Rahul Sundar, Dipanjan Majumdar, Chhote Lal Shah, Sunetra Sarkar

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computational Physics (physics.comp-ph); Fluid Dynamics (physics.flu-dyn)

[103] arXiv:2402.17652 [pdf, html, other]

Title: Compass: A Decentralized Scheduler for Latency-Sensitive ML Workflows

Yuting Yang, Andrea Merlina, Weijia Song, Tiancheng Yuan, Ken Birman, Roman Vitenberg

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[104] arXiv:2402.17674 [pdf, html, other]

Title: Highly-Efficient Persistent FIFO Queues

Panagiota Fatourou, Nikos Giachoudis, George Mallis

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[105] arXiv:2402.17868 [pdf, html, other]

Title: SmartQC: An Extensible DLT-Based Framework for Trusted Data Workflows in Smart Manufacturing

Alan McGibney, Tharindu Ranathunga, Roman Pospisil

Comments: 33 Pages, 9 Figures, Under Peer Review Process

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[106] arXiv:2402.17963 [pdf, html, other]

Title: The Design and Implementation of a High-Performance Log-Structured RAID System for ZNS SSDs

Jinhong Li, Qiuping Wang, Shujie Han, Patrick P. C. Lee

Comments: 35 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[107] arXiv:2402.18110 [pdf, html, other]

Title: The Logarithmic Random Bidding for the Parallel Roulette Wheel Selection with Precise Probabilities

Koji Nakano

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[108] arXiv:2402.18304 [pdf, html, other]

Title: Play like a Vertex: A Stackelberg Game Approach for Streaming Graph Partitioning

Zezhong Ding, Yongan Xiang, Shangyou Wang, Xike Xie, S. Kevin Zhou

Comments: This paper has been accepted by SIGMOD 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Databases (cs.DB); Computer Science and Game Theory (cs.GT)

[109] arXiv:2402.18480 [pdf, html, other]

Title: Libfork: portable continuation-stealing with stackless coroutines

Conor John Williams, James Elliott

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[110] arXiv:2402.18789 [pdf, html, other]

Title: FlexLLM: A System for Co-Serving Large Language Model Inference and Parameter-Efficient Finetuning

Gabriele Oliaro, Xupeng Miao, Xinhao Cheng, Vineeth Kada, Ruohan Gao, Yingyi Huang, Remi Delacourt, April Yang, Yingcheng Wang, Mengdi Wu, Colin Unger, Zhihao Jia

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL); Machine Learning (cs.LG)

[111] arXiv:2402.19364 [pdf, html, other]

Title: Arrow Matrix Decomposition: A Novel Approach for Communication-Efficient Sparse Matrix Multiplication

Lukas Gianinazzi, Alexandros Nikolaos Ziogas, Langwen Huang, Piotr Luczynski, Saleh Ashkboos, Florian Scheidl, Armon Carigiet, Chio Ge, Nabil Abubaker, Maciej Besta, Tal Ben-Nun, Torsten Hoefler

Journal-ref: PPoPP'24: Proceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (2024) 404-416

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[112] arXiv:2402.00138 (cross-list from cs.DS) [pdf, html, other]

Title: Decomposable Submodular Maximization in Federated Setting

Akbar Rafiey

Subjects: Data Structures and Algorithms (cs.DS); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[113] arXiv:2402.00208 (cross-list from cs.LG) [pdf, html, other]

Title: MP-SL: Multihop Parallel Split Learning

Joana Tirana, Spyros Lalis, Dimitris Chatzopoulos

Comments: 11 pages, 14 figures

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[114] arXiv:2402.00665 (cross-list from cs.DS) [pdf, html, other]

Title: Revising Apetrei's bounding volume hierarchy construction algorithm to allow stackless traversal

Andrey Prokopenko, Damien Lebrun-Grandié

Comments: 6 pages

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[115] arXiv:2402.01096 (cross-list from cs.LG) [pdf, html, other]

Title: Trustworthy Distributed AI Systems: Robustness, Privacy, and Governance

Wenqi Wei, Ling Liu

Comments: Manuscript accepted to ACM Computing Surveys

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[116] arXiv:2402.01140 (cross-list from cs.LG) [pdf, other]

Title: Root Cause Analysis In Microservice Using Neural Granger Causal Discovery

Cheng-Ming Lin, Ching Chang, Wei-Yao Wang, Kuang-Da Wang, Wen-Chih Peng

Comments: AAAI 2024 Main Track

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[117] arXiv:2402.01160 (cross-list from cs.LG) [pdf, other]

Title: Truncated Non-Uniform Quantization for Distributed SGD

Guangfeng Yan, Tan Li, Yuanzhang Xiao, Congduan Li, Linqi Song

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[118] arXiv:2402.01302 (cross-list from cs.LG) [pdf, html, other]

Title: A Unified Framework for Center-based Clustering of Distributed Data

Aleksandar Armacki, Dragana Bajović, Dušan Jakovetić, Soummya Kar

Comments: 49 pages, 9 figures, 7 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA)

[119] arXiv:2402.01350 (cross-list from cs.LG) [pdf, html, other]

Title: pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning

Liping Yi, Han Yu, Chao Ren, Heng Zhang, Gang Wang, Xiaoguang Liu, Xiaoxiao Li

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[120] arXiv:2402.01546 (cross-list from cs.LG) [pdf, other]

Title: Privacy-Preserving Distributed Learning for Residential Short-Term Load Forecasting

Yi Dong, Yingjie Wang, Mariana Gama, Mustafa A. Mustafa, Geert Deconinck, Xiaowei Huang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA); Systems and Control (eess.SY)

[121] arXiv:2402.01664 (cross-list from cs.NI) [pdf, other]

Title: Edge Offloading in Smart Grid

Gabriel Ioan Arcas, Tudor Cioara, Ionut Anghel, Dragos Lazea, Anca Hangan

Comments: to be submitted to journal

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[122] arXiv:2402.01739 (cross-list from cs.CL) [pdf, html, other]

Title: OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models

Fuzhao Xue, Zian Zheng, Yao Fu, Jinjie Ni, Zangwei Zheng, Wangchunshu Zhou, Yang You

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[123] arXiv:2402.01771 (cross-list from cs.CL) [pdf, html, other]

Title: BlackMamba: Mixture of Experts for State-Space Models

Quentin Anthony, Yury Tokpanov, Paolo Glorioso, Beren Millidge

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[124] arXiv:2402.01798 (cross-list from cs.LG) [pdf, html, other]

Title: Improved Quantization Strategies for Managing Heavy-tailed Gradients in Distributed Learning

Guangfeng Yan, Tan Li, Yuanzhang Xiao, Hanxu Hou, Linqi Song

Comments: arXiv admin note: substantial text overlap with arXiv:2402.01160

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[125] arXiv:2402.01816 (cross-list from cs.DS) [pdf, html, other]

Title: Simple Symmetric Sustainable Sorting -- the greeNsort article

Jens Oehlschlägel

Comments: 50 pages, 6 Figures, latest version under this https URL, see also this https URL

Subjects: Data Structures and Algorithms (cs.DS); Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

[126] arXiv:2402.01863 (cross-list from cs.LG) [pdf, html, other]

Title: DFML: Decentralized Federated Mutual Learning

Yasser H. Khalil, Amir H. Estiri, Mahdi Beitollahi, Nader Asadi, Sobhan Hemati, Xu Li, Guojun Zhang, Xi Chen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[127] arXiv:2402.01869 (cross-list from cs.LG) [pdf, html, other]

Title: InferCept: Efficient Intercept Support for Augmented Large Language Model Inference

Reyna Abhyankar, Zijian He, Vikranth Srivatsa, Hao Zhang, Yiying Zhang

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[128] arXiv:2402.02230 (cross-list from cs.LG) [pdf, other]

Title: Federated Learning with Differential Privacy

Adrien Banse, Jan Kreischer, Xavier Oliva i Jürgens

Comments: Machine Learning (ML) & Federated Learning (FL); 4 pages, 3 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[129] arXiv:2402.02521 (cross-list from cs.ET) [pdf, html, other]

Title: Neuromorphic hardware for sustainable AI data centers

Bernhard Vogginger, Amirhossein Rostami, Vaibhav Jain, Sirine Arfa, Andreas Hantsch, David Kappel, Michael Schäfer, Ulrike Faltings, Hector A. Gonzalez, Chen Liu, Christian Mayr, Wolfgang Maaß

Comments: 11 pages, 2 figures, presented as poster at NICE 2024, 2nd version with updated author list and minor updates

Subjects: Emerging Technologies (cs.ET); Distributed, Parallel, and Cluster Computing (cs.DC); Neural and Evolutionary Computing (cs.NE)

[130] arXiv:2402.02543 (cross-list from cs.GT) [pdf, html, other]

Title: Safeguarding the Truth of High-Value Price Oracle Task: A Dynamically Adjusted Truth Discovery Method

Youquan Xian, Peng Liu, Dongcheng Li, Xueying Zeng

Comments: 10 pages, 7 figures

Subjects: Computer Science and Game Theory (cs.GT); Computational Engineering, Finance, and Science (cs.CE); Distributed, Parallel, and Cluster Computing (cs.DC)

[131] arXiv:2402.02621 (cross-list from cs.IT) [pdf, other]

Title: Perfect Multi-User Distributed Computing

Ali Khalesi, Petros Elia

Comments: This paper is submitted to the IEEE International Symposium on Information Theory (ISIT) 2024

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[132] arXiv:2402.02630 (cross-list from cs.CR) [pdf, html, other]

Title: Cryptographically Assured Information Flow: Assured Remote Execution

Scott L. Dyer, Christian A. Femrite, Joshua D. Guttman, Julian P. Lanson, Moses D. Liskov

Comments: 38 this http URL are grateful to the MITRE Independent Research and Development Program for support

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[133] arXiv:2402.02795 (cross-list from cs.NI) [pdf, html, other]

Title: A Learning-Based Caching Mechanism for Edge Content Delivery

Hoda Torabi, Hamzeh Khazaei, Marin Litoiu

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[134] arXiv:2402.02885 (cross-list from cs.AI) [pdf, other]

Title: A Review on Building Blocks of Decentralized Artificial Intelligence

Vid Kersic, Muhamed Turkanovic

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[135] arXiv:2402.02951 (cross-list from cs.LG) [pdf, html, other]

Title: Dynamic Byzantine-Robust Learning: Adapting to Switching Byzantine Workers

Ron Dorfman, Naseem Yehya, Kfir Y. Levy

Comments: ICML 2024

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[136] arXiv:2402.03253 (cross-list from cs.LO) [pdf, other]

Title: Semitopology: distributed collaborative action via topology, algebra, and logic

Murdoch J. Gabbay

Comments: This document is a preprint of a monograph, which integrates material from papers arXiv:2303.09287 (for point-set semitopologies) and arXiv:2310.00956 (for algebra). This update corrects minor typos and omissions in the previous version

Subjects: Logic in Computer Science (cs.LO); Distributed, Parallel, and Cluster Computing (cs.DC); General Topology (math.GN)

[137] arXiv:2402.03408 (cross-list from cs.SE) [pdf, html, other]

Title: A Framework for Effective Invocation Methods of Various LLM Services

Can Wang, Dianbo Sui, Bolin Zhang, Xiaoyu Liu, Jiabao Kang, Zhidong Qiao, Zhiying Tu

Subjects: Software Engineering (cs.SE); Distributed, Parallel, and Cluster Computing (cs.DC)

[138] arXiv:2402.03448 (cross-list from cs.LG) [pdf, other]

Title: Decentralized Sporadic Federated Learning: A Unified Algorithmic Framework with Convergence Guarantees

Shahryar Zehtabi, Dong-Jun Han, Rohit Parasnis, Seyyedali Hosseinalipour, Christopher G. Brinton

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[139] arXiv:2402.03480 (cross-list from cs.LG) [pdf, html, other]

Title: Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision

Nathaniel Hudson, J. Gregory Pauloski, Matt Baughman, Alok Kamatar, Mansi Sakarvadia, Logan Ward, Ryan Chard, André Bauer, Maksim Levental, Wenyi Wang, Will Engler, Owen Price Skelly, Ben Blaiszik, Rick Stevens, Kyle Chard, Ian Foster

Comments: 10 pages, 3 figures, accepted for publication in the proceedings of the 10th IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT2023)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[140] arXiv:2402.03548 (cross-list from cs.LG) [pdf, html, other]

Title: Single-GPU GNN Systems: Traps and Pitfalls

Yidong Gong, Arnab Tarafder, Saima Afrin, Pradeep Kumar

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[141] arXiv:2402.03564 (cross-list from cs.LG) [pdf, html, other]

Title: SkipPredict: When to Invest in Predictions for Scheduling

Rana Shahout, Michael Mitzenmacher

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[142] arXiv:2402.04377 (cross-list from cs.LG) [pdf, html, other]

Title: NeRCC: Nested-Regression Coded Computing for Resilient Distributed Prediction Serving Systems

Parsa Moradi, Mohammad Ali Maddah-Ali

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[143] arXiv:2402.04409 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Fair, Robust and Efficient Client Contribution Evaluation in Federated Learning

Meiying Zhang, Huan Zhao, Sheldon Ebron, Kan Yang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[144] arXiv:2402.04506 (cross-list from astro-ph.IM) [pdf, html, other]

Title: Processing All-Sky Images At Scale On The Amazon Cloud: A HiPS Example

G. Bruce Berriman, John C. Good

Comments: 4 pages, 1 figure, ADASS 2024 proceedings

Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Distributed, Parallel, and Cluster Computing (cs.DC)

[145] arXiv:2402.05312 (cross-list from cs.NI) [pdf, html, other]

Title: SplitSim: Large-Scale Simulations for Evaluating Network Systems Research

Hejing Li, Praneeth Balasubramanian, Marvin Meiers, Jialin Li, Antoine Kaufmann

Comments: 12 pages, under submission to peer-reviewed conference

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[146] arXiv:2402.05353 (cross-list from cs.LG) [pdf, html, other]

Title: Revisiting Early-Learning Regularization When Federated Learning Meets Noisy Labels

Taehyeon Kim, Donggyu Kim, Se-Young Yun

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[147] arXiv:2402.05407 (cross-list from cs.LG) [pdf, other]

Title: Version age-based client scheduling policy for federated learning

Xinyi Hu, Nikolaos Pappas, Howard H. Yang

Comments: 5 pages, 4 figures, ICASSP 2024

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[148] arXiv:2402.05541 (cross-list from cs.LG) [pdf, html, other]

Title: FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated Learning

Jialuo He, Wei Chen, Xiaojin Zhang

Comments: AAAI 2025

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[149] arXiv:2402.05558 (cross-list from cs.LG) [pdf, other]

Title: Flashback: Understanding and Mitigating Forgetting in Federated Learning

Mohammed Aljahdali, Ahmed M. Abdelmoniem, Marco Canini, Samuel Horváth

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

[150] arXiv:2402.05968 (cross-list from cs.LG) [pdf, html, other]

Title: Federated Learning Priorities Under the European Union Artificial Intelligence Act

Herbert Woisetschläger, Alexander Erben, Bill Marino, Shiqiang Wang, Nicholas D. Lane, Ruben Mayer, Hans-Arno Jacobsen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC)