Distributed, Parallel, and Cluster Computing

Authors and titles for April 2021

[51] arXiv:2104.07574 [pdf, other]

Title: Who Needs Consensus? A Distributed Monetary System Between Rational Agents via Hearsay

Yanni Georghiades, Robert Streit, Vijay Garg

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[52] arXiv:2104.07857 [pdf, other]

Title: ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith, Yuxiong He

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Performance (cs.PF)

[53] arXiv:2104.08009 [pdf, other]

Title: Implementing CNN Layers on the Manticore Cluster-Based Many-Core Architecture

Andreas Kurth, Fabian Schuiki, Luca Benini

Comments: Technical report. 18 pages, 4 figures, 5 algorithms

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[54] arXiv:2104.08265 [pdf, other]

Title: Evaluation of Portable Acceleration Solutions for LArTPC Simulation Using Wire-Cell Toolkit

Haiwang Yu, Zhihua Dong, Kyle Knoepfel, Meifeng Lin, Brett Viren, Kwangmin Yu

Comments: 10 pages, vCHEP2021

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[55] arXiv:2104.08322 [pdf, other]

Title: libEnsemble: A Library to Coordinate the Concurrent Evaluation of Dynamic Ensembles of Calculations

Stephen Hudson, Jeffrey Larson, John-Luke Navarro, Stefan M. Wild

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[56] arXiv:2104.08364 [pdf, other]

Title: Sync-Switch: Hybrid Parameter Synchronization for Distributed Deep Learning

Shijian Li, Oren Mangoubi, Lijie Xu, Tian Guo

Comments: 15 pages, 16 figures, 6 tables, ICDCS'21

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Performance (cs.PF)

[57] arXiv:2104.08396 [pdf, other]

Title: Yelp Dataset Analysis using Scalable Big Data

Mohsen Alam, Benjamin Cevallos, Oscar Flores, Randall Lunetto, Kotaro Yayoshi, Jongwook Woo

Comments: 4 pages, 11 figures, 4 tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

[58] arXiv:2104.08461 [pdf, other]

Title: PPoL: A Periodic Channel Hopping Sequence with Nearly Full Rendezvous Diversity

Yi-Jheng Lin, Cheng-Shang Chang

Comments: 5 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Discrete Mathematics (cs.DM); Information Theory (cs.IT)

[59] arXiv:2104.08571 [pdf, other]

Title: Ripple : Simplified Large-Scale Computation on Heterogeneous Architectures with Polymorphic Data Layout

Robert Clucas, Philip Blakely, Nikolaos Nikiforakis

Comments: Preprint submitted to the Journal of Parallel and Distributed Computing

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

[60] arXiv:2104.08644 [pdf, other]

Title: Labeling Schemes for Deterministic Radio Multi-Broadcast

Colin Krisko, Avery Miller

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[61] arXiv:2104.09075 [pdf, other]

Title: An Oracle for Guiding Large-Scale Model/Hybrid Parallel Training of Convolutional Neural Networks

Albert Njoroge Kahira, Truong Thao Nguyen, Leonardo Bautista Gomez, Ryousei Takano, Rosa M Badia, Mohamed Wahib

Comments: The International ACM Symposium on High-Performance Parallel and Distributed Computing 2021 (HPDC'21)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[62] arXiv:2104.09455 [pdf, other]

Title: Arithmetic-Intensity-Guided Fault Tolerance for Neural Network Inference on GPUs

Jack Kosaian, K. V. Rashmi

Comments: Appeared in The International Conference for High Performance Computing, Networking, Storage and Analysis (SC '21), November 14--19, 2021, St. Louis, MO, USA

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[63] arXiv:2104.09565 [pdf, other]

Title: Accelerating key bioinformatics tasks 100-fold by improving memory access

Igor Sfiligoi, Daniel McDonald, Rob Knight

Comments: 6 pages, 3 tables, 7 algorithms, To be published in Proceedings of PEARC21

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Genomics (q-bio.GN)

[64] arXiv:2104.09616 [pdf, other]

Title: MELOPPR: Software/Hardware Co-design for Memory-efficient Low-latency Personalized PageRank

Lixiang Li, Yao Chen, Zacharie Zirnheld, Pan Li, Cong Hao

Comments: Accepted by IEEE Design Automation Conference, 2021 (DAC'21). Six pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR)

[65] arXiv:2104.09801 [pdf, other]

Title: Leveraging Public-Private Blockchain Interoperability for Closed Consortium Interfacing

Bishakh Chandra Ghosh, Tanay Bhartia, Sourav Kanti Addya, Sandip Chakraborty

Comments: 10 pages, 12 figures, accepted for publication in IEEE INFOCOM 2021

Journal-ref: IEEE INFOCOM 2021

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[66] arXiv:2104.09902 [pdf, other]

Title: Upper and Lower Bounds for Deterministic Approximate Objects

Danny Hendler, Adnane Khattabi, Alessia Milani, Corentin Travers

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[67] arXiv:2104.09949 [pdf, other]

Title: DynO: Dynamic Onloading of Deep Neural Networks from Cloud to Device

Mario Almeida, Stefanos Laskaridis, Stylianos I. Venieris, Ilias Leontiadis, Nicholas D. Lane

Comments: Accepted for publication at the ACM Transactions on Embedded Computing Systems (TECS) in the special issue on Accelerating AI on the Edge

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[68] arXiv:2104.10013 [pdf, other]

Title: Parallel Physics-Informed Neural Networks via Domain Decomposition

Khemraj Shukla, Ameya D. Jagtap, George Em Karniadakis

Comments: 23 pages, 13 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[69] arXiv:2104.10022 [pdf, other]

Title: A Decentralized Shared CAV System Design and Application

Sayed Mehdi Meshkani, Bilal Farooq

Comments: Presented at TRISTAN X, 17-21 June 2019, Hamilton Island, Australia

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)

[70] arXiv:2104.10025 [pdf, other]

Title: Assessing the Effectiveness of (Parallel) Branch-and-bound Algorithms

Stephen J. Maher, Ted K. Ralphs, Yuji Shinano

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[71] arXiv:2104.10027 [pdf, other]

Title: HTN Planning Domain for Deployment of Cloud Applications

Ilche Georgievski

Comments: Published in the proceedings of the 10th International Planning Competition: Planner and Domain Abstracts - Hierarchical Task Network (HTN) Planning Track

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[72] arXiv:2104.10039 [pdf, other]

Title: GraphGuess: Approximate Graph Processing System with Adaptive Correction

Morteza Ramezani, Mahmut T. Kandemir, Anand Sivasubramaniam

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[73] arXiv:2104.10042 [pdf, other]

Title: A Brief Overview of the UML Scientific Profile

Vasyliy I. Gurianov

Comments: 6 pages, 3 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Programming Languages (cs.PL); Software Engineering (cs.SE)

[74] arXiv:2104.10073 [pdf, other]

Title: ZMCintegral-v5.1: Support for Multi-function Integrations on GPUs

Xiao-Yan Cao, Jun-Jie Zhang

Comments: 5pages, 1figure

Journal-ref: Computer Physics Communications Volume 265, August 2021, 107994

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); High Energy Physics - Phenomenology (hep-ph)

[75] arXiv:2104.10106 [pdf, other]

Title: ds-array: A Distributed Data Structure for Large Scale Machine Learning

Javier Álvarez Cid-Fuentes, Pol Álvarez, Salvi Solà, Kuninori Ishii, Rafael K. Morizawa, Rosa M. Badia

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[76] arXiv:2104.10407 [pdf, other]

Title: Analysis of Distributed Average Consensus Algorithms for Robust IoT networks

Sateeshkrishna Dhuli, Fouzul Atik

Comments: 8 pages, 10 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[77] arXiv:2104.10501 [pdf, other]

Title: A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Things

Jiehan Zhou, Shouhua Zhang, Qinghua Lu, Wenbin Dai, Min Chen, Xin Liu, Susanna Pirttikangas, Yang Shi, Weishan Zhang, Enrique Herrera-Viedma

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[78] arXiv:2104.11272 [pdf, other]

Title: Towards Offloadable and Migratable Microservices on Disaggregated Architectures: Vision, Challenges, and Research Roadmap

Xiaoyi Lu, Arjun Kashyap

Comments: 7 pages, 2 figures, WORDS'21, co-located with ASPLOS'21

Journal-ref: WORDS 2021: The Second Workshop On Resource Disaggregation and Serverless

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[79] arXiv:2104.11349 [pdf, other]

Title: Scalable Predictive Time-Series Analysis of COVID-19: Cases and Fatalities

Shradha Shinde, Jay Joshi, Sowmya Mareedu, Yeon Pyo Kim, Jongwook Woo

Comments: 8 pages, 7 figures, 4 tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[80] arXiv:2104.11375 [pdf, other]

Title: Decentralized Federated Averaging

Tao Sun, Dongsheng Li, Bao Wang

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[81] arXiv:2104.11385 [pdf, other]

Title: In-Situ Assessment of Device-Side Compute Work for Dynamic Load Balancing in a GPU-Accelerated PIC Code

Michael E. Rowan, Axel Huebl, Kevin N. Gott, Jack Deslippe, Maxence Thévenet, Remi Lehe, Jean-Luc Vay

Comments: 11 pages, 8 figures. Paper accepted in the Platform for Advanced Scientific Computing Conference (PASC '21), July 5 to 9, 2021, Geneva, Switzerland

Journal-ref: PASC 2021: Proceedings of the Platform for Advanced Scientific Computing Conference

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Accelerator Physics (physics.acc-ph); Computational Physics (physics.comp-ph); Plasma Physics (physics.plasm-ph)

[82] arXiv:2104.11471 [pdf, other]

Title: tcFFT: Accelerating Half-Precision FFT through Tensor Cores

Binrui Li, Shenggan Cheng, James Lin

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[83] arXiv:2104.11958 [pdf, other]

Title: On system rollback and totalised fields

Mark Burgess, Alva Couch

Journal-ref: Journal of Logic and Algebraic Programming 80 (2011), pp. 427-443

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[84] arXiv:2104.12057 [pdf, other]

Title: A Subquadratic-Time Distributed Algorithm for Exact Maximum Matching

Naoki Kitamura, Taisuke Izumi

Comments: 19 pages, 4figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[85] arXiv:2104.12197 [pdf, other]

Title: RDMAbox : Optimizing RDMA for Memory Intensive Workloads

Juhyun Bae, Ling Liu, Yanzhao Wu, Gong Su, Arun Iyengar

Comments: 10 pages, 12 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[86] arXiv:2104.12202 [pdf, other]

Title: Power of Finite Memory and Finite Communication Robots under Asynchronous Scheduler

Archak Das, Avisek Sharma, Buddhadeb Sau

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[87] arXiv:2104.12350 [pdf, other]

Title: A PGAS Communication Library for Heterogeneous Clusters

Varun Sharma, Paul Chow

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR)

[88] arXiv:2104.12425 [pdf, other]

Title: Separating Data via Block Invalidation Time Inference for Write Amplification Reduction in Log-Structured Storage

Qiuping Wang, Jinhong Li, Patrick P. C. Lee, Tao Ouyang, Chao Shi, Lilong Huang

Comments: 19 pages. Accepted by the 20th USENIX Conference on File and Storage Technologies (FAST '22)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[89] arXiv:2104.12466 [pdf, other]

Title: Microservice Dynamic Architecture-Level Deployment Orchestration (Extended Version)

Lorenzo Bacchiani, Mario Bravetti, Saverio Giallorenzo, Jacopo Mauro, Iacopo Talevi, Gianluigi Zavattaro

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[90] arXiv:2104.12911 [pdf, other]

Title: Quasi-Dynamic Traffic Assignment using High Performance Computing

Cy Chan, Anu Kuncheria, Bingyu Zhao, Theophile Cabannes, Alexander Keimer, Bin Wang, Alexandre Bayen, Jane Macfarlane

Comments: 28 pages, 13 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[91] arXiv:2104.13092 [pdf, other]

Title: Towards On-Device Federated Learning: A Direct Acyclic Graph-based Blockchain Approach

Mingrui Cao, Long Zhang, Bin Cao

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[92] arXiv:2104.13144 [pdf, other]

Title: Block Access Control in Wireless Blockchain Network: Design, Modeling and Analysis

Yixin Li, Bin Cao, Liang Liang, Deming Mao, Lei Zhang

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[93] arXiv:2104.13209 [pdf, other]

Title: Parallel K-Clique Counting on GPUs

Mohammad Almasri, Izzat El Hajj, Rakesh Nagi, Jinjun Xiong, Wen-mei Hwu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[94] arXiv:2104.13248 [pdf, other]

Title: Performance Portable Back-projection Algorithms on CPUs: Agnostic Data Locality and Vectorization Optimizations

Peng Chen, Mohamed Wahib, Xiao Wang, Shinichiro Takizawa, Takahiro Hirofuchi, Hirotaka Ogawa, Satoshi Matsuoka

Comments: ACM International Conference on Supercomputing 2021 (ICS'21)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[95] arXiv:2104.13263 [pdf, other]

Title: Designing a scalable framework for declarative automation on distributed systems

J. Lowell Wofford

Comments: 12 pages, 6 figures, Submitted to SC21

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[96] arXiv:2104.13429 [pdf, other]

Title: Pronto: Federated Task Scheduling

Andreas Grammenos, Evangelia Kalyvianaki, Peter Pietzuch

Comments: 19 pages, 7 figures, 7 tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[97] arXiv:2104.13499 [pdf, other]

Title: Communication Costs in a Geometric Communication Network

Sima Hajiaghaei Shanjani, Valerie King

Comments: A version of this work was submitted to ICDCN 2021

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computational Geometry (cs.CG)

[98] arXiv:2104.13819 [pdf, other]

Title: Towards Decentralized Complex Queries over Distributed Ledgers: a Data Marketplace Use-case

Mirko Zichichi, Luca Serena, Stefano Ferretti, Gabriele D'Angelo

Journal-ref: Proceedings of the IEEE 30th International Conference on Computer Communications and Networks (ICCCN 2021)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Cryptography and Security (cs.CR); Networking and Internet Architecture (cs.NI); Social and Information Networks (cs.SI)

[99] arXiv:2104.13869 [pdf, other]

Title: Faa$T: A Transparent Auto-Scaling Cache for Serverless Applications

Francisco Romero, Gohar Irfan Chaudhry, Íñigo Goiri, Pragna Gopa, Paul Batum, Neeraja J. Yadwadkar, Rodrigo Fonseca, Christos Kozyrakis, Ricardo Bianchini

Comments: 18 pages, 15 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[100] arXiv:2104.13974 [pdf, other]

Title: Joint QoS-aware and Cost-efficient Task Scheduling for Fog-Cloud Resources in a Volunteer Computing System

Farooq Hoseiny, Sadoon Azizi, Mohammad Shojafar, Rahim Tafazolli

Comments: 21 pages, 6 figures, ACM Transactions on Internet Technology (TOIT)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)