Distributed, Parallel, and Cluster Computing

Authors and titles for May 2023

[151] arXiv:2305.19946 [pdf, other]

Title: A Survey of Potential MPI Complex Collectives: Large-Scale Mining and Analysis of HPC Applications

Pouya Haghi, Ryan Marshall, Po Hao Chen, Anthony Skjellum, Martin Herbordt

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[152] arXiv:2305.20027 [pdf, other]

Title: A Simple Python Testbed for Federated Learning Algorithms

Miroslav Popovic, Marko Popovic, Ivan Kastelan, Miodrag Djukic, Silvia Ghilezan

Comments: 6 pages, 7 figures, 3 algorithms, as accepted at ZINC 2023, Published by IEEE Xplore

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[153] arXiv:2305.00771 (cross-list from cs.LG) [pdf, other]

Title: Towards Unbiased Training in Federated Open-world Semi-supervised Learning

Jie Zhang, Xiaosong Ma, Song Guo, Wenchao Xu

Comments: 12 pages

Journal-ref: ICML2023

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[154] arXiv:2305.00856 (cross-list from cs.NI) [pdf, other]

Title: Analyzing Transatlantic Network Traffic over Scientific Data Caches

Z. Deng, A. Sim, K. Wu, C. Guok, D. Hazen, I. Monga, F. Andrijauskas, F. Wuerthwein, D. Weitzel

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[155] arXiv:2305.00873 (cross-list from cs.LG) [pdf, other]

Title: Towards the Flatter Landscape and Better Generalization in Federated Learning under Client-level Differential Privacy

Yifan Shi, Kang Wei, Li Shen, Yingqi Liu, Xueqian Wang, Bo Yuan, Dacheng Tao

Comments: 20 pages. arXiv admin note: substantial text overlap with arXiv:2303.11242

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[156] arXiv:2305.01154 (cross-list from cs.LG) [pdf, html, other]

Title: FedAVO: Improving Communication Efficiency in Federated Learning with African Vultures Optimizer

Md Zarif Hossain, Ahmed Imteaj

Comments: 8 pages

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[157] arXiv:2305.01238 (cross-list from cs.LG) [pdf, other]

Title: Dynamic Scheduling for Federated Edge Learning with Streaming Data

Chung-Hsuan Hu, Zheng Chen, Erik G. Larsson

Comments: Accepted for publication in the proceedings of 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) workshop

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI)

[158] arXiv:2305.01324 (cross-list from cs.DS) [pdf, other]

Title: The Complexity of Distributed Approximation of Packing and Covering Integer Linear Programs

Yi-Jun Chang, Zeyong Li

Comments: in PODC 2023

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[159] arXiv:2305.01519 (cross-list from cs.LG) [pdf, other]

Title: BCEdge: SLO-Aware DNN Inference Services with Adaptive Batching on Edge Platforms

Ziyang Zhang, Huan Li, Yang Zhao, Changyao Lin, Jie Liu

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Operating Systems (cs.OS)

[160] arXiv:2305.01588 (cross-list from cs.LG) [pdf, other]

Title: Revisiting Gradient Clipping: Stochastic bias and tight convergence guarantees

Anastasia Koloskova, Hadrien Hendrikx, Sebastian U. Stich

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC); Machine Learning (stat.ML)

[161] arXiv:2305.01657 (cross-list from cs.LG) [pdf, other]

Title: Scalable Data Point Valuation in Decentralized Learning

Konstantin D. Pandl, Chun-Yin Huang, Ivan Beschastnikh, Xiaoxiao Li, Scott Thiebes, Ali Sunyaev

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[162] arXiv:2305.01771 (cross-list from eess.SY) [pdf, other]

Title: Fault Tolerant Processing Unit Using Gamma Distribution Sliding Window For Autonomous Landing Guidance System

Hossam O. Ahmed

Comments: 21st IEEE Interregional NEWCAS Conference, Edinburgh, Scotland

Subjects: Systems and Control (eess.SY); Distributed, Parallel, and Cluster Computing (cs.DC)

[163] arXiv:2305.01868 (cross-list from cs.LG) [pdf, other]

Title: Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models

Daochen Zha, Louis Feng, Liang Luo, Bhargav Bhushanam, Zirui Liu, Yusuo Hu, Jade Nie, Yuzhen Huang, Yuandong Tian, Arun Kejariwal, Xia Hu

Comments: Accepted by MLSys 2023. Code available at this https URL

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR); Performance (cs.PF)

[164] arXiv:2305.01890 (cross-list from cs.NI) [pdf, other]

Title: Scheduling Network Function Chains Under Sub-Millisecond Latency SLOs

Jianfeng Wang, Siddhant Gupta, Marcos A. M. Vieira, Barath Raghavan, Ramesh Govindan

Comments: 12 pages + 3 pages (reference)

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[165] arXiv:2305.02219 (cross-list from cs.LG) [pdf, other]

Title: LESS-VFL: Communication-Efficient Feature Selection for Vertical Federated Learning

Timothy Castiglia, Yi Zhou, Shiqiang Wang, Swanand Kadhe, Nathalie Baracaldo, Stacy Patterson

Comments: Published in ICML 2023

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[166] arXiv:2305.02377 (cross-list from cs.CR) [pdf, other]

Title: Privacy in Population Protocols with Probabilistic Scheduling

Talley Amir, James Aspnes

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[167] arXiv:2305.02854 (cross-list from cs.DS) [pdf, other]

Title: Distributed Construction of Near-Optimal Compact Routing Schemes for Planar Graphs

Jinfeng Dou, Thorsten Götte, Henning Hillebrandt, Christian Scheideler, Julian Werthmann

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[168] arXiv:2305.03152 (cross-list from cs.LG) [pdf, other]

Title: Communication-Efficient Graph Neural Networks with Probabilistic Neighborhood Expansion Analysis and Caching

Tim Kaler, Alexandros-Stavros Iliopoulos, Philip Murzynowski, Tao B. Schardl, Charles E. Leiserson, Jie Chen

Comments: MLSys 2023. Code is available at this https URL

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

[169] arXiv:2305.03357 (cross-list from math.AT) [pdf, html, other]

Title: Persistent homology of partially ordered spaces

Cameron Calk, Eric Goubault, Philippe Malbos

Subjects: Algebraic Topology (math.AT); Distributed, Parallel, and Cluster Computing (cs.DC); Logic in Computer Science (cs.LO)

[170] arXiv:2305.03969 (cross-list from cs.IT) [pdf, html, other]

Title: Joint Compression and Deadline Optimization for Wireless Federated Learning

Maojun Zhang, Yang Li, Dongzhu Liu, Richeng Jin, Guangxu Zhu, Caijun Zhong, Tony Q.S. Quek

Comments: 13 pages, accepted by IEEE Transactions on Mobile Computing (TMC)

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[171] arXiv:2305.04059 (cross-list from cs.LG) [pdf, other]

Title: Decentralised Semi-supervised Onboard Learning for Scene Classification in Low-Earth Orbit

Johan Östman, Pablo Gomez, Vinutha Magal Shreenath, Gabriele Meoni

Comments: Accepted at IAA SSEO 2023

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA)

[172] arXiv:2305.04555 (cross-list from eess.SY) [pdf, other]

Title: Consensus analysis of random sub-graphs for distributed filtering with link failures

Stefano Battilotti, Filippo Cacace, Massimiliano d'Angelo

Comments: Full version of the paper with the same title submitted to IEEE Transactions on Automatic Control as a Technical Note

Subjects: Systems and Control (eess.SY); Distributed, Parallel, and Cluster Computing (cs.DC)

[173] arXiv:2305.04635 (cross-list from math.NA) [pdf, other]

Title: Parallel Cholesky Factorization for Banded Matrices using OpenMP Tasks

Felix Liu, Albin Fredriksson, Stefano Markidis

Subjects: Numerical Analysis (math.NA); Distributed, Parallel, and Cluster Computing (cs.DC)

[174] arXiv:2305.04979 (cross-list from cs.LG) [pdf, other]

Title: FedHB: Hierarchical Bayesian Federated Learning

Minyoung Kim, Timothy Hospedales

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[175] arXiv:2305.05055 (cross-list from cs.DS) [pdf, other]

Title: CPMA: An Efficient Batch-Parallel Compressed Set Without Pointers

Brian Wheatman, Randal Burns, Aydın Buluç, Helen Xu

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

[176] arXiv:2305.05090 (cross-list from cs.LG) [pdf, other]

Title: Performative Federated Learning: A Solution to Model-Dependent and Heterogeneous Distribution Shifts

Kun Jin, Tongxin Yin, Zhongzhu Chen, Zeyu Sun, Xueru Zhang, Yang Liu, Mingyan Liu

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[177] arXiv:2305.05118 (cross-list from cs.LG) [pdf, html, other]

Title: Flame: Simplifying Topology Extension in Federated Learning

Harshit Daga, Jaemin Shin, Dhruv Garg, Ada Gavrilovska, Myungjin Lee, Ramana Rao Kompella

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[178] arXiv:2305.05238 (cross-list from quant-ph) [pdf, other]

Title: Architectural Vision for Quantum Computing in the Edge-Cloud Continuum

Alireza Furutanpey, Johanna Barzen, Marvin Bechtold, Schahram Dustdar, Frank Leymann, Philipp Raith, Felix Truger

Comments: 16 pages, 5 figures, Vision Paper

Subjects: Quantum Physics (quant-ph); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[179] arXiv:2305.05257 (cross-list from cs.LG) [pdf, other]

Title: Survey of Federated Learning Models for Spatial-Temporal Mobility Applications

Yacine Belal, Sonia Ben Mokhtar, Hamed Haddadi, Jaron Wang, Afra Mashhadi

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR); Social and Information Networks (cs.SI)

[180] arXiv:2305.05455 (cross-list from cs.NI) [pdf, html, other]

Title: ONCache: A Cache-Based Low-Overhead Container Overlay Network

Shengkai Lin, Shizhen Zhao, Peirui Cao, Xinchi Han, Quan Tian, Wenfeng Liu, Qi Wu, Donghai Han, Xinbing Wang

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Operating Systems (cs.OS)

[181] arXiv:2305.05463 (cross-list from cs.NI) [pdf, html, other]

Title: Multi-Tier Hierarchical Federated Learning-assisted NTN for Intelligent IoT Services

Amin Farajzadeh, Animesh Yadav, Halim Yanikomeroglu

Comments: Submitted to IEEE for possible publication

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[182] arXiv:2305.05479 (cross-list from cs.CR) [pdf, other]

Title: Multiple-stopping time Sequential Detection for Energy Efficient Mining in Blockchain-Enabled IoT

Anurag Gupta, Vikram Krishnamurthy

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Signal Processing (eess.SP); Systems and Control (eess.SY)

[183] arXiv:2305.05514 (cross-list from cs.IT) [pdf, other]

Title: Multi-access Coded Caching with Linear Subpacketization

Srinivas Reddy Kota, Nikhil Karamchandani

Comments: 11 pages, 1 figure, ISIT 2023

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[184] arXiv:2305.05644 (cross-list from cs.CL) [pdf, html, other]

Title: Towards Building the Federated GPT: Federated Instruction Tuning

Jianyi Zhang, Saeed Vahidian, Martin Kuo, Chunyuan Li, Ruiyi Zhang, Tong Yu, Yufan Zhou, Guoyin Wang, Yiran Chen

Comments: Project page: this https URL

Subjects: Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)

[185] arXiv:2305.05920 (cross-list from cs.LG) [pdf, html, other]

Title: Fast Distributed Inference Serving for Large Language Models

Bingyang Wu, Yinmin Zhong, Zili Zhang, Shengyu Liu, Fangyue Liu, Yuanhang Sun, Gang Huang, Xuanzhe Liu, Xin Jin

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[186] arXiv:2305.06120 (cross-list from cs.DS) [pdf, other]

Title: Average Awake Complexity of MIS and Matching

Mohsen Ghaffari, Julian Portmann

Comments: Appeared at SPAA'22

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[187] arXiv:2305.06238 (cross-list from cs.PL) [pdf, other]

Title: Designing Asynchronous Multiparty Protocols with Crash-Stop Failures

Adam D. Barwell, Ping Hou, Nobuko Yoshida, Fangyi Zhou

Comments: ECOOP 2023

Subjects: Programming Languages (cs.PL); Distributed, Parallel, and Cluster Computing (cs.DC)

[188] arXiv:2305.06272 (cross-list from cs.IR) [pdf, html, other]

Title: FedPDD: A Privacy-preserving Double Distillation Framework for Cross-silo Federated Recommendation

Sheng Wan, Dashan Gao, Hanlin Gu, Daning Hu

Comments: Accepted by IJCNN2023

Subjects: Information Retrieval (cs.IR); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[189] arXiv:2305.06452 (cross-list from cs.DS) [pdf, other]

Title: A Near-Optimal Deterministic Distributed Synchronizer

Mohsen Ghaffari, Anton Trygub

Comments: Appears at PODC 2023

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[190] arXiv:2305.06468 (cross-list from cs.CR) [pdf, other]

Title: Universally Composable Simultaneous Broadcast against a Dishonest Majority and Applications

Myrto Arapinis, Ábel Kocsis, Nikolaos Lamprou, Liam Medley, Thomas Zacharias

Comments: Full version of the PODC 2023 camera-ready version Single-column format; main body restructuring

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[191] arXiv:2305.06526 (cross-list from cs.IT) [pdf, other]

Title: Probabilistic Group Testing in Distributed Computing with Attacked Workers

Sarthak Jain, Martina Cardone, Soheil Mohajer

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[192] arXiv:2305.06865 (cross-list from cs.LG) [pdf, other]

Title: Multi-Tier Client Selection for Mobile Federated Learning Networks

Yulan Gao, Yansong Zhao, Han Yu

Comments: Accepted by IEEE International Conference on Multimedia and Expo 2023

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)

[193] arXiv:2305.06906 (cross-list from cs.NI) [pdf, other]

Title: ns-O-RAN: Simulating O-RAN 5G Systems in ns-3

Andrea Lacava, Matteo Bordin, Michele Polese, Rajarajan Sivaraj, Tommaso Zugno, Francesca Cuomo, Tommaso Melodia

Comments: 10 pages, 6 figures, 1 table, 5 listings. Accepted at the 2023 Workshop on ns-3 (WNS3 2023), June 28-29, 2023, Arlington, VA, USA. ACM, New York, NY, USA

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[194] arXiv:2305.07083 (cross-list from cs.GR) [pdf, other]

Title: Scalable Ray Tracing Using the Distributed FrameBuffer

Will Usher, Ingo Wald, Jefferson Amstutz, Johannes Günther, Carson Brownlee, Valerio Pascucci

Subjects: Graphics (cs.GR); Distributed, Parallel, and Cluster Computing (cs.DC)

[195] arXiv:2305.07091 (cross-list from math.OC) [pdf, other]

Title: Stability and Convergence of Distributed Stochastic Approximations with large Unbounded Stochastic Information Delays

Adrian Redder, Arunselvan Ramaswamy, Holger Karl

Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Multiagent Systems (cs.MA); Dynamical Systems (math.DS)

[196] arXiv:2305.07119 (cross-list from cs.CV) [pdf, other]

Title: Graph Neural Network for Accurate and Low-complexity SAR ATR

Bingyi Zhang, Sasindu Wijeratne, Rajgopal Kannan, Viktor Prasanna, Carl Busart

Subjects: Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

[197] arXiv:2305.07377 (cross-list from cs.MA) [pdf, html, other]

Title: On a Voter Model with Context-Dependent Opinion Adoption

Luca Becchetti, Vincenzo Bonifaci, Emilio Cruciani, Francesco Pasquale

Journal-ref: Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI 2023). Pages 38-45

Subjects: Multiagent Systems (cs.MA); Distributed, Parallel, and Cluster Computing (cs.DC)

[198] arXiv:2305.07612 (cross-list from cs.LG) [pdf, html, other]

Title: Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression

Yutong He, Xinmeng Huang, Yiming Chen, Wotao Yin, Kun Yuan

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[199] arXiv:2305.07651 (cross-list from cs.SE) [pdf, other]

Title: Predicting Resource Consumption of Kubernetes Container Systems using Resource Models

Gianluca Turin, Andrea Borgarelli, Simone Donetti, Ferruccio Damiani, Einar Broch Johnsen, Silvia Lizeth Tapia Tarifa

Comments: 34 pages. Preprint, to appear in the Journal of Systems and Software

Subjects: Software Engineering (cs.SE); Distributed, Parallel, and Cluster Computing (cs.DC)

[200] arXiv:2305.07758 (cross-list from cs.PL) [pdf, other]

Title: Linearizability Analysis of the Contention-Friendly Binary Search Tree

Uri Abraham, Avi Hayoun

Subjects: Programming Languages (cs.PL); Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)