Distributed, Parallel, and Cluster Computing

Authors and titles for November 2020

[101] arXiv:2011.00071 (cross-list from cs.LG) [pdf, other]

Title: Training EfficientNets at Supercomputer Scale: 83% ImageNet Top-1 Accuracy in One Hour

Arissa Wongpanich, Hieu Pham, James Demmel, Mingxing Tan, Quoc Le, Yang You, Sameer Kumar

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

[102] arXiv:2011.00087 (cross-list from cs.CR) [pdf, other]

Title: Low Latency Cross-Shard Transactions in Coded Blockchain

Canran Wang, Netanel Raviv

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[103] arXiv:2011.00330 (cross-list from cs.LG) [pdf, other]

Title: Resource Allocation in Multi-armed Bandit Exploration: Overcoming Sublinear Scaling with Adaptive Parallelism

Brijen Thananjeyan, Kirthevasan Kandasamy, Ion Stoica, Michael I. Jordan, Ken Goldberg, Joseph E. Gonzalez

Comments: Accepted to ICML 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[104] arXiv:2011.00443 (cross-list from cs.CV) [pdf, other]

Title: A Parallel Approach for Real-Time Face Recognition from a Large Database

Ashish Ranjan, Varun Nagesh Jolly Behera, Motahar Reza

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[105] arXiv:2011.00667 (cross-list from math.OC) [pdf, other]

Title: Asynchronous Parallel Stochastic Quasi-Newton Methods

Qianqian Tong, Guannan Liang, Xingyu Cai, Chunjiang Zhu, Jinbo Bi

Comments: Accepted by Parallel Computing Journal

Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC)

[106] arXiv:2011.00715 (cross-list from cs.MS) [pdf, other]

Title: Toward Performance-Portable PETSc for GPU-based Exascale Systems

Richard Tran Mills, Mark F. Adams, Satish Balay, Jed Brown, Alp Dener, Matthew Knepley, Scott E. Kruger, Hannah Morgan, Todd Munson, Karl Rupp, Barry F. Smith, Stefano Zampini, Hong Zhang, Junchao Zhang

Comments: 15 pages, 10 figures, 2 tables

Subjects: Mathematical Software (cs.MS); Distributed, Parallel, and Cluster Computing (cs.DC)

[107] arXiv:2011.00892 (cross-list from cs.RO) [pdf, other]

Title: A Formally Verified Fail-Operational Safety Concept for Automated Driving

Yuting Fu, Andrei Terechko, Jan Friso Groote, Arash Khabbaz Saberi

Comments: 11 pages, 5 figures, 3 tables

Journal-ref: SAE International Journal of Connected and Automated Vehicles 2022

Subjects: Robotics (cs.RO); Distributed, Parallel, and Cluster Computing (cs.DC); Formal Languages and Automata Theory (cs.FL); Systems and Control (eess.SY)

[108] arXiv:2011.01057 (cross-list from cs.MA) [pdf, other]

Title: The Persistence of False Memory: Brain in a Vat Despite Perfect Clocks

Thomas Schlögl (1), Ulrich Schmid (1), Roman Kuznets (1) ((1) TU Wien, Vienna, Austria)

Comments: 34 pages, 2 figures

Journal-ref: Proceedings of PRIMA 2020, LNCS v. 12568 (2021), pp. 403-411

Subjects: Multiagent Systems (cs.MA); Distributed, Parallel, and Cluster Computing (cs.DC)

[109] arXiv:2011.01096 (cross-list from cs.NI) [pdf, other]

Title: Blockchain for Decentralization of Internet: Prospects, Trends, and Challenges

Javad Zarrin, Phang Hao Wen, Lakshmi Babu Saheer, Bahram Zarrin

Comments: Under Review in Cluster Computing, Springer

Journal-ref: Cluster Computing 2021

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET)

[110] arXiv:2011.01207 (cross-list from physics.comp-ph) [pdf, other]

Title: Tinker-HP : Accelerating Molecular Dynamics Simulations of Large Complex Systems with Advanced Point Dipole Polarizable Force Fields using GPUs and Multi-GPUs systems

Olivier Adjoua, Louis Lagardère, Luc-Henri Jolly, Arnaud Durocher, Thibaut Very, Isabelle Dupays, Zhi Wang, Théo Jaffrelot Inizan, Frédéric Célerse, Pengyu Ren, Jay W. Ponder, Jean-Philip Piquemal

Journal-ref: Journal of Chemical Theory and Computation, 2021, 17, 4, 2034-2053

Subjects: Computational Physics (physics.comp-ph); Distributed, Parallel, and Cluster Computing (cs.DC); Mathematical Software (cs.MS); Chemical Physics (physics.chem-ph)

[111] arXiv:2011.01334 (cross-list from cs.LG) [pdf, other]

Title: Impact of Community Structure on Consensus Machine Learning

Bao Huynh, Haimonti Dutta, Dane Taylor

Comments: 9 pages; 5 figures

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Distributed, Parallel, and Cluster Computing (cs.DC); Probability (math.PR)

[112] arXiv:2011.01367 (cross-list from cs.CR) [pdf, other]

Title: A position paper on GDPR compliance in sharded blockchains: rehash of old ideas or new interesting challenges?

Narasimha Raghavan Veeraragavan, Kaiwen Zhang

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[113] arXiv:2011.01383 (cross-list from cs.LG) [pdf, other]

Title: Cortex: A Compiler for Recursive Deep Learning Models

Pratik Fegade, Tianqi Chen, Phillip B. Gibbons, Todd C. Mowry

Comments: 11 pages, 12 figures and 6 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[114] arXiv:2011.01410 (cross-list from cs.NI) [pdf, other]

Title: Multi-level Forwarding and Scheduling Recovery Algorithm in Rapidly-changing Network for Erasure-coded Clusters

Hai Zhou, Dan Feng, Yuchong Hu

Comments: We have modified the algorithm of this article, and a submission meeting is required. However, the meeting request cannot be published, so we apply to withdraw the article

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[115] arXiv:2011.01783 (cross-list from cs.LG) [pdf, other]

Title: An Efficiency-boosting Client Selection Scheme for Federated Learning with Fairness Guarantee

Tiansheng Huang, Weiwei Lin, Wentai Wu, Ligang He, Keqin Li, Albert Y.Zomaya

Comments: Accepted by IEEE TPDS. DOI: https://doi.org/10.1109/TPDS.2020.3040887

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[116] arXiv:2011.01922 (cross-list from cs.IT) [pdf, other]

Title: Gradient Coding with Dynamic Clustering for Straggler Mitigation

Baturalp Buyukates, Emre Ozfatura, Sennur Ulukus, Deniz Gunduz

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Signal Processing (eess.SP)

[117] arXiv:2011.02046 (cross-list from cs.DS) [pdf, other]

Title: Beyond Worst-case Analysis of Multicore Caching Strategies

Shahin Kamali, Helen Xu

Comments: 22 pages, short version to appear in APOCS 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[118] arXiv:2011.02367 (cross-list from cs.LG) [pdf, other]

Title: Federated Knowledge Distillation

Hyowoon Seo, Jihong Park, Seungeun Oh, Mehdi Bennis, Seong-Lyun Kim

Comments: 30 pages, 12 figures, 2 tables; This chapter is written for the forthcoming book, Machine Learning and Wireless Communications (Cambridge University Press), edited by H. V. Poor, D. Gunduz, A. Goldsmith, and Y. Eldar

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI)

[119] arXiv:2011.02412 (cross-list from cs.CY) [pdf, other]

Title: Identity and Personhood in Digital Democracy: Evaluating Inclusion, Equality, Security, and Privacy in Pseudonym Parties and Other Proofs of Personhood

Bryan Ford

Subjects: Computers and Society (cs.CY); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI)

[120] arXiv:2011.02600 (cross-list from math.NA) [pdf, other]

Title: Upwind summation by parts finite difference methods for large scale elastic wave simulations in 3D complex geometries

Kenneth Duru, Frederick Fung, Christopher Williams

Subjects: Numerical Analysis (math.NA); Distributed, Parallel, and Cluster Computing (cs.DC); Geophysics (physics.geo-ph)

[121] arXiv:2011.02749 (cross-list from cs.IT) [pdf, other]

Title: Straggler Mitigation through Unequal Error Protection for Distributed Matrix Multiplication

Busra Tegin, Eduin E. Hernandez, Stefano Rini, Tolga M. Duman

Comments: 6 pages, 6 figures

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[122] arXiv:2011.02999 (cross-list from cs.LG) [pdf, other]

Title: CPR: Understanding and Improving Failure Tolerant Training for Deep Learning Recommendation with Partial Recovery

Kiwan Maeng, Shivam Bharuka, Isabel Gao, Mark C. Jeffrey, Vikram Saraph, Bor-Yiing Su, Caroline Trippel, Jiyan Yang, Mike Rabbat, Brandon Lucia, Carole-Jean Wu

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[123] arXiv:2011.03180 (cross-list from cs.LG) [pdf, other]

Title: FedSL: Federated Split Learning on Distributed Sequential Data in Recurrent Neural Networks

Ali Abedi, Shehroz S. Khan

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[124] arXiv:2011.03190 (cross-list from cs.AR) [pdf, other]

Title: ReFloat: Low-Cost Floating-Point Processing in ReRAM for Accelerating Iterative Linear Solvers

Linghao Song, Fan Chen, Xuehai Qian, Hai Li, Yiran Chen

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[125] arXiv:2011.03206 (cross-list from cs.LG) [pdf, other]

Title: Resource-Constrained Federated Learning with Heterogeneous Labels and Models

Gautham Krishna Gudur, Bala Shyamala Balaji, Satheesh K. Perepu

Comments: 6 pages, 5 figures, ACM KDD 2020 (The 3rd International Workshop on Artificial Intelligence of Things - AIoT'20)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)