Distributed, Parallel, and Cluster Computing

Authors and titles for August 2020

[126] arXiv:2008.00581 (cross-list from cs.IT) [pdf, other]

Title: A Combinatorial Design for Cascaded Coded Distributed Computing on General Networks

Nicholas Woolsey, Rong-Rong Chen, Mingyue Ji

Comments: 30 pages, 6 figures

Subjects: Information Theory (cs.IT); Computational Complexity (cs.CC); Distributed, Parallel, and Cluster Computing (cs.DC)

[127] arXiv:2008.00638 (cross-list from cs.LG) [pdf, other]

Title: High Throughput Matrix-Matrix Multiplication between Asymmetric Bit-Width Operands

Dibakar Gope, Jesse Beu, Matthew Mattina

Subjects: Machine Learning (cs.LG); Hardware Architecture (cs.AR); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[128] arXiv:2008.00742 (cross-list from cs.LG) [pdf, other]

Title: Collaborative Learning in the Jungle (Decentralized, Byzantine, Heterogeneous, Asynchronous and Nonconvex Learning)

El-Mahdi El-Mhamdi, Sadegh Farhadkhani, Rachid Guerraoui, Arsany Guirguis, Lê Nguyên Hoang, Sébastien Rouault

Comments: 34 pages, 1 figure

Journal-ref: NeurIPS 2021

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[129] arXiv:2008.00824 (cross-list from cs.AI) [pdf, other]

Title: State-of-the-art Techniques in Deep Edge Intelligence

Ahnaf Hannan Lodhi, Barış Akgün, Öznur Özkasap

Comments: 13 pages, 5 figures, 1 table

Subjects: Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Signal Processing (eess.SP)

[130] arXiv:2008.00879 (cross-list from cs.IT) [pdf, other]

Title: Failure Probability Analysis for Partial Extraction from Invertible Bloom Filters

Ivo Kubjas, Vitaly Skachek

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[131] arXiv:2008.01124 (cross-list from cs.NE) [pdf, other]

Title: Analyzing the Components of Distributed Coevolutionary GAN Training

Jamal Toutouh, Erik Hemberg, Una-May O'Reilly

Comments: Accepted as a full paper in Sixteenth International Conference on Parallel Problem Solving from Nature (PPSN XVI)

Subjects: Neural and Evolutionary Computing (cs.NE); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[132] arXiv:2008.01144 (cross-list from eess.SP) [pdf, other]

Title: Energy-Aware Graph Task Scheduling in Software-Defined Air-Ground Integrated Vehicular Networks

Minghui LiWang, Zhibin Gao, Xianbin Wang

Comments: 14 pages, 8 figures

Subjects: Signal Processing (eess.SP); Distributed, Parallel, and Cluster Computing (cs.DC)

[133] arXiv:2008.01425 (cross-list from cs.LG) [pdf, other]

Title: PowerGossip: Practical Low-Rank Communication Compression in Decentralized Deep Learning

Thijs Vogels, Sai Praneeth Karimireddy, Martin Jaggi

Comments: To appear in NeurIPS 2020

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC); Machine Learning (stat.ML)

[134] arXiv:2008.01990 (cross-list from cs.MS) [pdf, other]

Title: A parallel structured divide-and-conquer algorithm for symmetric tridiagonal eigenvalue problems

Xia Liao, Shengguo Li, Yutong Lu, Jose E. Roman

Comments: 17 pages, 9 figures

Journal-ref: IEEE Transactions on Parallel and Distributed Systems 32 (2021) 367-378

Subjects: Mathematical Software (cs.MS); Distributed, Parallel, and Cluster Computing (cs.DC)

[135] arXiv:2008.02352 (cross-list from cs.DB) [pdf, other]

Title: Efficient Compactions Between Storage Tiers with PrismDB

Ashwini Raina, Jianan Lu, Asaf Cidon, Michael J. Freedman

Subjects: Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC)

[136] arXiv:2008.02452 (cross-list from cs.LG) [pdf, other]

Title: Federated Transfer Learning with Dynamic Gradient Aggregation

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[137] arXiv:2008.02710 (cross-list from math.NA) [pdf, other]

Title: Red Light Green Light Method for Solving Large Markov Chains

Konstantin Avrachenkov, Patrick Brown, Nelly Litvak

Journal-ref: Journal of Scientific Computing, v.93, 18 (2022)

Subjects: Numerical Analysis (math.NA); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC); Probability (math.PR)

[138] arXiv:2008.03066 (cross-list from cs.NI) [pdf, other]

Title: A Game-Theoretic Drone-as-a-Service Composition for Delivery

Babar Shahzaad, Athman Bouguettaya, Sajib Mistry

Comments: 5 pages, 3 figures. This is an accepted paper and it is going to appear in the Proceedings of the 2020 IEEE International Conference on Web Services (IEEE ICWS 2020) affiliated with the 2020 IEEE World Congress on Services (IEEE SERVICES 2020), Beijing, China

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[139] arXiv:2008.03091 (cross-list from cs.DS) [pdf, other]

Title: Low-Congestion Shortcuts for Graphs Excluding Dense Minors

Mohsen Ghaffari, Bernhard Haeupler

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC); Combinatorics (math.CO)

[140] arXiv:2008.03260 (cross-list from cs.DB) [pdf, other]

Title: Distributed Tera-Scale Similarity Search with MPI: Provably Efficient Similarity Search over billions without a Single Distance Computation

Nicholas Meisburger, Anshumali Shrivastava

Subjects: Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[141] arXiv:2008.03371 (cross-list from cs.LG) [pdf, other]

Title: LotteryFL: Personalized and Communication-Efficient Federated Learning with Lottery Ticket Hypothesis on Non-IID Datasets

Ang Li, Jingwei Sun, Binghui Wang, Lin Duan, Sicheng Li, Yiran Chen, Hai Li

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[142] arXiv:2008.03433 (cross-list from cs.LG) [pdf, other]

Title: GPU-Accelerated Primal Learning for Extremely Fast Large-Scale Classification

John T. Halloran, David M. Rocke

Comments: 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Quantitative Methods (q-bio.QM); Machine Learning (stat.ML)

[143] arXiv:2008.03602 (cross-list from cs.NE) [pdf, other]

Title: Spatial Sharing of GPU for Autotuning DNN models

Aditya Dhakal, Junguk Cho, Sameer G. Kulkarni, K. K. Ramakrishnan, Puneet Sharma

Subjects: Neural and Evolutionary Computing (cs.NE); Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)

[144] arXiv:2008.03606 (cross-list from cs.LG) [pdf, other]

Title: Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning

Sai Praneeth Karimireddy, Martin Jaggi, Satyen Kale, Mehryar Mohri, Sashank J. Reddi, Sebastian U. Stich, Ananda Theertha Suresh

Comments: Version 2 provides stronger theoretical results and more thorough experiments

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC); Machine Learning (stat.ML)

[145] arXiv:2008.03715 (cross-list from eess.SP) [pdf, other]

Title: A Modular Approach for Synchronized Wireless Multimodal Multisensor Data Acquisition in Highly Dynamic Social Settings

Chirag Raman, Stephanie Tan, Hayley Hung

Comments: 9 pages, 8 figures, Proceedings of the 28th ACM International Conference on Multimedia (MM '20), October 12--16, 2020, Seattle, WA, USA. First two authors contributed equally

Subjects: Signal Processing (eess.SP); Distributed, Parallel, and Cluster Computing (cs.DC); Multimedia (cs.MM)

[146] arXiv:2008.04699 (cross-list from cs.LG) [pdf, other]

Title: Byzantine Fault-Tolerant Distributed Machine Learning Using Stochastic Gradient Descent (SGD) and Norm-Based Comparative Gradient Elimination (CGE)

Nirupam Gupta, Shuo Liu, Nitin H. Vaidya

Comments: The report includes 52 pages, and 16 figures. Extension of our prior work on Byzantine fault-tolerant distribution optimization (arXiv:1903.08752 and doi:https://doi.org/10.1145/3382734.3405748) to Byzantine fault-tolerant distributed machine learning; Updated to the full version of workshop paper in DSN-DSML '21

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[147] arXiv:2008.05070 (cross-list from eess.SP) [pdf, other]

Title: Research on the construction method of vehicle driving cycle based on Mean Shift clustering

Yongjiang He

Subjects: Signal Processing (eess.SP); Distributed, Parallel, and Cluster Computing (cs.DC)

[148] arXiv:2008.05141 (cross-list from cs.IT) [pdf, other]

Title: Coded Elastic Computing on Machines with Heterogeneous Storage and Computation Speed

Nicholas Woolsey, Rong-Rong Chen, Mingyue Ji

Comments: 30 pages, 4 figures

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[149] arXiv:2008.05255 (cross-list from cs.CV) [pdf, other]

Title: Identity-Aware Attribute Recognition via Real-Time Distributed Inference in Mobile Edge Clouds

Zichuan Xu, Jiangkai Wu, Qiufen Xia, Pan Zhou, Jiankang Ren, Huizhi Liang

Comments: 9 pages, 8 figures, Proceedings of the 28th ACM International Conference on Multimedia (ACM MM'20), Seattle, WA, USA

Subjects: Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Multimedia (cs.MM); Networking and Internet Architecture (cs.NI)

[150] arXiv:2008.05631 (cross-list from cs.IT) [pdf, other]

Title: FLCD: A Flexible Low Complexity Design of Coded Distributed Computing

Nicholas Woolsey, Xingyue Wang, Rong-Rong Chen, Mingyue Ji

Comments: 13 pages, 4 figures

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)