Distributed, Parallel, and Cluster Computing

Authors and titles for November 2020

[101] arXiv:2011.00071 (cross-list from cs.LG) [pdf, other]

Title: Training EfficientNets at Supercomputer Scale: 83% ImageNet Top-1 Accuracy in One Hour

Arissa Wongpanich, Hieu Pham, James Demmel, Mingxing Tan, Quoc Le, Yang You, Sameer Kumar

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

[102] arXiv:2011.00087 (cross-list from cs.CR) [pdf, other]

Title: Low Latency Cross-Shard Transactions in Coded Blockchain

Canran Wang, Netanel Raviv

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[103] arXiv:2011.00330 (cross-list from cs.LG) [pdf, other]

Title: Resource Allocation in Multi-armed Bandit Exploration: Overcoming Sublinear Scaling with Adaptive Parallelism

Brijen Thananjeyan, Kirthevasan Kandasamy, Ion Stoica, Michael I. Jordan, Ken Goldberg, Joseph E. Gonzalez

Comments: Accepted to ICML 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[104] arXiv:2011.00443 (cross-list from cs.CV) [pdf, other]

Title: A Parallel Approach for Real-Time Face Recognition from a Large Database

Ashish Ranjan, Varun Nagesh Jolly Behera, Motahar Reza

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[105] arXiv:2011.00667 (cross-list from math.OC) [pdf, other]

Title: Asynchronous Parallel Stochastic Quasi-Newton Methods

Qianqian Tong, Guannan Liang, Xingyu Cai, Chunjiang Zhu, Jinbo Bi

Comments: Accepted by Parallel Computing Journal

Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC)

[106] arXiv:2011.00715 (cross-list from cs.MS) [pdf, other]

Title: Toward Performance-Portable PETSc for GPU-based Exascale Systems

Richard Tran Mills, Mark F. Adams, Satish Balay, Jed Brown, Alp Dener, Matthew Knepley, Scott E. Kruger, Hannah Morgan, Todd Munson, Karl Rupp, Barry F. Smith, Stefano Zampini, Hong Zhang, Junchao Zhang

Comments: 15 pages, 10 figures, 2 tables

Subjects: Mathematical Software (cs.MS); Distributed, Parallel, and Cluster Computing (cs.DC)

[107] arXiv:2011.00892 (cross-list from cs.RO) [pdf, other]

Title: A Formally Verified Fail-Operational Safety Concept for Automated Driving

Yuting Fu, Andrei Terechko, Jan Friso Groote, Arash Khabbaz Saberi

Comments: 11 pages, 5 figures, 3 tables

Journal-ref: SAE International Journal of Connected and Automated Vehicles 2022

Subjects: Robotics (cs.RO); Distributed, Parallel, and Cluster Computing (cs.DC); Formal Languages and Automata Theory (cs.FL); Systems and Control (eess.SY)

[108] arXiv:2011.01057 (cross-list from cs.MA) [pdf, other]

Title: The Persistence of False Memory: Brain in a Vat Despite Perfect Clocks

Thomas Schlögl (1), Ulrich Schmid (1), Roman Kuznets (1) ((1) TU Wien, Vienna, Austria)

Comments: 34 pages, 2 figures

Journal-ref: Proceedings of PRIMA 2020, LNCS v. 12568 (2021), pp. 403-411

Subjects: Multiagent Systems (cs.MA); Distributed, Parallel, and Cluster Computing (cs.DC)

[109] arXiv:2011.01096 (cross-list from cs.NI) [pdf, other]

Title: Blockchain for Decentralization of Internet: Prospects, Trends, and Challenges

Javad Zarrin, Phang Hao Wen, Lakshmi Babu Saheer, Bahram Zarrin

Comments: Under Review in Cluster Computing, Springer

Journal-ref: Cluster Computing 2021

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET)

[110] arXiv:2011.01207 (cross-list from physics.comp-ph) [pdf, other]

Title: Tinker-HP : Accelerating Molecular Dynamics Simulations of Large Complex Systems with Advanced Point Dipole Polarizable Force Fields using GPUs and Multi-GPUs systems

Olivier Adjoua, Louis Lagardère, Luc-Henri Jolly, Arnaud Durocher, Thibaut Very, Isabelle Dupays, Zhi Wang, Théo Jaffrelot Inizan, Frédéric Célerse, Pengyu Ren, Jay W. Ponder, Jean-Philip Piquemal

Journal-ref: Journal of Chemical Theory and Computation, 2021, 17, 4, 2034-2053

Subjects: Computational Physics (physics.comp-ph); Distributed, Parallel, and Cluster Computing (cs.DC); Mathematical Software (cs.MS); Chemical Physics (physics.chem-ph)

[111] arXiv:2011.01334 (cross-list from cs.LG) [pdf, other]

Title: Impact of Community Structure on Consensus Machine Learning

Bao Huynh, Haimonti Dutta, Dane Taylor

Comments: 9 pages; 5 figures

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Distributed, Parallel, and Cluster Computing (cs.DC); Probability (math.PR)

[112] arXiv:2011.01367 (cross-list from cs.CR) [pdf, other]

Title: A position paper on GDPR compliance in sharded blockchains: rehash of old ideas or new interesting challenges?

Narasimha Raghavan Veeraragavan, Kaiwen Zhang

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[113] arXiv:2011.01383 (cross-list from cs.LG) [pdf, other]

Title: Cortex: A Compiler for Recursive Deep Learning Models

Pratik Fegade, Tianqi Chen, Phillip B. Gibbons, Todd C. Mowry

Comments: 11 pages, 12 figures and 6 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[114] arXiv:2011.01410 (cross-list from cs.NI) [pdf, other]

Title: Multi-level Forwarding and Scheduling Recovery Algorithm in Rapidly-changing Network for Erasure-coded Clusters

Hai Zhou, Dan Feng, Yuchong Hu

Comments: We have modified the algorithm of this article, and a submission meeting is required. However, the meeting request cannot be published, so we apply to withdraw the article

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[115] arXiv:2011.01783 (cross-list from cs.LG) [pdf, other]

Title: An Efficiency-boosting Client Selection Scheme for Federated Learning with Fairness Guarantee

Tiansheng Huang, Weiwei Lin, Wentai Wu, Ligang He, Keqin Li, Albert Y.Zomaya

Comments: Accepted by IEEE TPDS. DOI: https://doi.org/10.1109/TPDS.2020.3040887

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[116] arXiv:2011.01922 (cross-list from cs.IT) [pdf, other]

Title: Gradient Coding with Dynamic Clustering for Straggler Mitigation

Baturalp Buyukates, Emre Ozfatura, Sennur Ulukus, Deniz Gunduz

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Signal Processing (eess.SP)

[117] arXiv:2011.02046 (cross-list from cs.DS) [pdf, other]

Title: Beyond Worst-case Analysis of Multicore Caching Strategies

Shahin Kamali, Helen Xu

Comments: 22 pages, short version to appear in APOCS 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[118] arXiv:2011.02367 (cross-list from cs.LG) [pdf, other]

Title: Federated Knowledge Distillation

Hyowoon Seo, Jihong Park, Seungeun Oh, Mehdi Bennis, Seong-Lyun Kim

Comments: 30 pages, 12 figures, 2 tables; This chapter is written for the forthcoming book, Machine Learning and Wireless Communications (Cambridge University Press), edited by H. V. Poor, D. Gunduz, A. Goldsmith, and Y. Eldar

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI)

[119] arXiv:2011.02412 (cross-list from cs.CY) [pdf, other]

Title: Identity and Personhood in Digital Democracy: Evaluating Inclusion, Equality, Security, and Privacy in Pseudonym Parties and Other Proofs of Personhood

Bryan Ford

Subjects: Computers and Society (cs.CY); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI)

[120] arXiv:2011.02600 (cross-list from math.NA) [pdf, other]

Title: Upwind summation by parts finite difference methods for large scale elastic wave simulations in 3D complex geometries

Kenneth Duru, Frederick Fung, Christopher Williams

Subjects: Numerical Analysis (math.NA); Distributed, Parallel, and Cluster Computing (cs.DC); Geophysics (physics.geo-ph)

[121] arXiv:2011.02749 (cross-list from cs.IT) [pdf, other]

Title: Straggler Mitigation through Unequal Error Protection for Distributed Matrix Multiplication

Busra Tegin, Eduin E. Hernandez, Stefano Rini, Tolga M. Duman

Comments: 6 pages, 6 figures

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[122] arXiv:2011.02999 (cross-list from cs.LG) [pdf, other]

Title: CPR: Understanding and Improving Failure Tolerant Training for Deep Learning Recommendation with Partial Recovery

Kiwan Maeng, Shivam Bharuka, Isabel Gao, Mark C. Jeffrey, Vikram Saraph, Bor-Yiing Su, Caroline Trippel, Jiyan Yang, Mike Rabbat, Brandon Lucia, Carole-Jean Wu

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[123] arXiv:2011.03180 (cross-list from cs.LG) [pdf, other]

Title: FedSL: Federated Split Learning on Distributed Sequential Data in Recurrent Neural Networks

Ali Abedi, Shehroz S. Khan

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[124] arXiv:2011.03190 (cross-list from cs.AR) [pdf, other]

Title: ReFloat: Low-Cost Floating-Point Processing in ReRAM for Accelerating Iterative Linear Solvers

Linghao Song, Fan Chen, Xuehai Qian, Hai Li, Yiran Chen

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[125] arXiv:2011.03206 (cross-list from cs.LG) [pdf, other]

Title: Resource-Constrained Federated Learning with Heterogeneous Labels and Models

Gautham Krishna Gudur, Bala Shyamala Balaji, Satheesh K. Perepu

Comments: 6 pages, 5 figures, ACM KDD 2020 (The 3rd International Workshop on Artificial Intelligence of Things - AIoT'20)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)

[126] arXiv:2011.03208 (cross-list from cs.CR) [pdf, other]

Title: Federated Crowdsensing: Framework and Challenges

Leye Wang, Han Yu, Xiao Han

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[127] arXiv:2011.03248 (cross-list from cs.LG) [pdf, other]

Title: ASFGNN: Automated Separated-Federated Graph Neural Network

Longfei Zheng, Jun Zhou, Chaochao Chen, Bingzhe Wu, Li Wang, Benyu Zhang

Comments: 15 pages

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[128] arXiv:2011.03479 (cross-list from cs.LG) [pdf, other]

Title: Massively Parallel Graph Drawing and Representation Learning

Christian Böhm, Claudia Plant

Journal-ref: IEEE BigData 2020

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[129] arXiv:2011.03605 (cross-list from cs.LG) [pdf, other]

Title: Highly Available Data Parallel ML training on Mesh Networks

Sameer Kumar, Norm Jouppi

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[130] arXiv:2011.03641 (cross-list from cs.LG) [pdf, other]

Title: Exploring the limits of Concurrency in ML Training on Google TPUs

Sameer Kumar, James Bradbury, Cliff Young, Yu Emma Wang, Anselm Levskaya, Blake Hechtman, Dehao Chen, HyoukJoong Lee, Mehmet Deveci, Naveen Kumar, Pankaj Kanwar, Shibo Wang, Skye Wanderman-Milne, Steve Lacy, Tao Wang, Tayo Oguntebi, Yazhou Zu, Yuanzhong Xu, Andy Swing

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[131] arXiv:2011.04050 (cross-list from cs.LG) [pdf, other]

Title: Adaptive Federated Dropout: Improving Communication Efficiency and Generalization for Federated Learning

Nader Bouacida, Jiahui Hou, Hui Zang, Xin Liu

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[132] arXiv:2011.04511 (cross-list from cs.DS) [pdf, other]

Title: Deterministic Distributed Vertex Coloring: Simpler, Faster, and without Network Decomposition

Mohsen Ghaffari, Fabian Kuhn

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[133] arXiv:2011.04726 (cross-list from cs.LG) [pdf, other]

Title: TrimTuner: Efficient Optimization of Machine Learning Jobs in the Cloud via Sub-Sampling

Pedro Mendes, Maria Casimiro, Paolo Romano, David Garlan

Comments: Mascots 2020

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[134] arXiv:2011.04727 (cross-list from cs.AR) [pdf, other]

Title: von Neumann's missing "Second Draft": what it should contain

János Végh

Comments: 5 pages, 4 figures. Accepted to 2020 International Conference on Computational Science and Computational Intelligence, Las Vegas, US, as paper CSCI2019

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[135] arXiv:2011.04893 (cross-list from cs.PF) [pdf, other]

Title: Resource Allocation in One-dimensional Distributed Service Networks with Applications

Nitish K. Panigrahy, Prithwish Basu, Philippe Nain, Don Towsley, Ananthram Swami, Kevin S. Chan, Kin K. Leung

Comments: arXiv admin note: text overlap with arXiv:1901.02414

Subjects: Performance (cs.PF); Distributed, Parallel, and Cluster Computing (cs.DC)

[136] arXiv:2011.04919 (cross-list from cs.CR) [pdf, other]

Title: Tokoin: A Coin-Based Accountable Access Control Scheme for Internet of Things

Chunchi Liu, Minghui Xu, Hechuan Guo, Xiuzhen Cheng, Yinhao Xiao, Dongxiao Yu, Bei Gong, Arkady Yerukhimovich, Shengling Wang, Weifeng Lv

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[137] arXiv:2011.05022 (cross-list from cs.LG) [pdf, other]

Title: Distributed Learning with Low Communication Cost via Gradient Boosting Untrained Neural Network

Xiatian Zhang, Xunshi He, Nan Wang, Rong Chen

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[138] arXiv:2011.05277 (cross-list from cs.NE) [pdf, other]

Title: Qualities, challenges and future of genetic algorithms: a literature review

Aymeric Vie, Alissa M. Kleinnijenhuis, Doyne J. Farmer

Comments: Early draft, feedback is welcome

Subjects: Neural and Evolutionary Computing (cs.NE); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[139] arXiv:2011.05755 (cross-list from q-bio.QM) [pdf, other]

Title: Cryo-RALib -- a modular library for accelerating alignment in cryo-EM

Szu-Chi Chung, Cheng-Yu Hung, Huei-Lun Siao, Hung-Yi Wu, Wei-Hau Chang, I-Ping Tu

Subjects: Quantitative Methods (q-bio.QM); Distributed, Parallel, and Cluster Computing (cs.DC); Image and Video Processing (eess.IV)

[140] arXiv:2011.06201 (cross-list from cs.CR) [pdf, other]

Title: Secure Regenerating Codes for Reducing Storage and Bootstrap Costs in Sharded Blockchains

Divija Swetha Gadiraju, V. Lalitha, Vaneet Aggarwal

Comments: 8 pages, accepted for publication in IEEE Blockchain 2020. arXiv admin note: text overlap with arXiv:1906.12140 by other authors

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[141] arXiv:2011.06283 (cross-list from cs.LG) [pdf, other]

Title: Fed-Focal Loss for imbalanced data classification in Federated Learning

Dipankar Sarkar, Ankur Narang, Sumit Rai

Comments: Accepted for the Workshop on Federated Learning for Data Privacy and Confidentiality in Conjunction with IJCAI 2020 (FL-IJCAI'20)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[142] arXiv:2011.06391 (cross-list from cs.LG) [pdf, other]

Title: FusedMM: A Unified SDDMM-SpMM Kernel for Graph Embedding and Graph Neural Networks

Md. Khaledur Rahman, Majedul Haque Sujon, Ariful Azad

Comments: 11 pages, published in IEEE IPDPS 2021

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI)

[143] arXiv:2011.06495 (cross-list from cs.LG) [pdf, other]

Title: Distributed Sparse SGD with Majority Voting

Kerem Ozfatura, Emre Ozfatura, Deniz Gunduz

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[144] arXiv:2011.06892 (cross-list from cs.LG) [pdf, other]

Title: Hybrid Federated and Centralized Learning

Ahmet M. Elbir, Sinem Coleri, Kumar Vijay Mishra

Comments: 5pages4figures. This work has been submitted to the IEEE for publication

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Signal Processing (eess.SP)

[145] arXiv:2011.07179 (cross-list from cs.LG) [pdf, other]

Title: A Theoretical Perspective on Differentially Private Federated Multi-task Learning

Huiwen Wu, Cen Chen, Li Wang

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[146] arXiv:2011.07229 (cross-list from cs.LG) [pdf, other]

Title: CatFedAvg: Optimising Communication-efficiency and Classification Accuracy in Federated Learning

Dipankar Sarkar, Sumit Rai, Ankur Narang

Comments: Supplementary material included

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[147] arXiv:2011.07429 (cross-list from cs.LG) [pdf, other]

Title: Dynamic backdoor attacks against federated learning

Anbu Huang

Comments: 8 pages

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[148] arXiv:2011.07516 (cross-list from cs.LG) [pdf, other]

Title: 2CP: Decentralized Protocols to Transparently Evaluate Contributivity in Blockchain Federated Learning Environments

Harry Cai, Daniel Rueckert, Jonathan Passerat-Palmbach

Journal-ref: IEEE 2nd International Workshop on Advances in Artificial Intelligence for Blockchain (AIChain 2020)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[149] arXiv:2011.07764 (cross-list from cs.CR) [pdf, other]

Title: Improved hierarchical role based access control model for cloud computing

N.N.Thilakarathne, Dilani Wickramaaarachchi

Journal-ref: International Research Conference on Smart Computing and Systems Engineering ( 2018 )

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[150] arXiv:2011.07846 (cross-list from cs.SE) [pdf, other]

Title: Secure Vehicle Communications Using Proof-of-Nonce Blockchain

N. Y. Ahn, D.H. Lee

Comments: 6 pages, 4 figures, IEEE Communication Magazine (Submitted on Nov. 16, 2020)

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)