Neural and Evolutionary Computing

Authors and titles for December 2020

[51] arXiv:2012.02327 (cross-list from cs.CL) [pdf, other]

Title: Evolving Character-Level DenseNet Architectures using Genetic Programming

Trevor Londt, Xiaoying Gao, Peter Andreae

Comments: Submitted to EvoStar 2021

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[52] arXiv:2012.02659 (cross-list from cs.AI) [pdf, other]

Title: Understanding Attention: In Minds and Machines

Shriraj P. Sawant, Shruti Singh

Comments: Accepted at NeurIPS 2020 Workshop: ML Retrospectives, Surveys & Meta-Analyses (ML-RSA)

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[53] arXiv:2012.02909 (cross-list from cs.CV) [pdf, other]

Title: What Makes a "Good" Data Augmentation in Knowledge Distillation -- A Statistical Perspective

Huan Wang, Suhas Lohit, Mike Jones, Yun Fu

Comments: Camera Ready of NeurIPS'22. Code: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[54] arXiv:2012.02911 (cross-list from cs.CV) [pdf, other]

Title: Multi-head Knowledge Distillation for Model Compression

Huan Wang, Suhas Lohit, Michael Jones, Yun Fu

Comments: Copyright: 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[55] arXiv:2012.02974 (cross-list from cs.LG) [pdf, other]

Title: A Review of Designs and Applications of Echo State Networks

Chenxi Sun, Moxian Song, Shenda Hong, Hongyan Li

Comments: 37 pages, 5 figures, 2 tables

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[56] arXiv:2012.03312 (cross-list from quant-ph) [pdf, other]

Title: Quantum Dynamics of Optimization Problems

Peng Wang, Gang Xin, Yuwei Jiao

Comments: We corrected some errors in the theoretical part of the paper, especially the quantum interpretation part corresponding to the approximation of the objective function. At the same time, we have added some comparative experiments and quantum effect experiments of skeleton algorithms, and hope to publish them in a new paper (arXiv:2106.13927)

Subjects: Quantum Physics (quant-ph); Neural and Evolutionary Computing (cs.NE)

[57] arXiv:2012.03378 (cross-list from cs.AI) [pdf, other]

Title: Brain Co-Processors: Using AI to Restore and Augment Brain Function

Rajesh P. N. Rao

Comments: arXiv admin note: text overlap with arXiv:1811.11876

Subjects: Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Adaptation and Self-Organizing Systems (nlin.AO); Neurons and Cognition (q-bio.NC)

[58] arXiv:2012.03405 (cross-list from cs.LG) [pdf, other]

Title: The Neural Coding Framework for Learning Generative Models

Alexander Ororbia, Daniel Kifer

Comments: Next round revisions made -- additional results, diagrams, naming convention and framework organization updated (see both main text and manuscript)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[59] arXiv:2012.03774 (cross-list from cs.LG) [pdf, other]

Title: Learning to extrapolate using continued fractions: Predicting the critical temperature of superconductor materials

Pablo Moscato, Mohammad Nazmul Haque, Kevin Huang, Julia Sloan, Jon C. de Oliveira

Comments: Submitted to Algorithms ( ISSN: 1999-4893 )

Journal-ref: Algorithms 2023, 16(8), 382

Subjects: Machine Learning (cs.LG); Superconductivity (cond-mat.supr-con); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[60] arXiv:2012.03793 (cross-list from cs.LG) [pdf, other]

Title: Inter-layer Information Similarity Assessment of Deep Neural Networks Via Topological Similarity and Persistence Analysis of Data Neighbour Dynamics

Andrew Hryniowski, Alexander Wong

Comments: 6 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[61] arXiv:2012.03837 (cross-list from cs.LG) [pdf, other]

Title: Parallel Training of Deep Networks with Local Updates

Michael Laskin, Luke Metz, Seth Nabarro, Mark Saroufim, Badreddine Noune, Carlo Luschi, Jascha Sohl-Dickstein, Pieter Abbeel

Comments: First two authors - Michael Laskin and Luke Metz - contributed equally. Order was determined by a coin flip

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[62] arXiv:2012.04115 (cross-list from stat.ML) [pdf, other]

Title: Generalization bounds for deep learning

Guillermo Valle-Pérez, Ard A. Louis

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[63] arXiv:2012.04163 (cross-list from cs.CR) [pdf, other]

Title: Privacy-Preserving Spam Filtering using Functional Encryption

Sicong Wang, Naveen Karunanayake, Tham Nguyen, Suranga Seneviratne

Subjects: Cryptography and Security (cs.CR); Neural and Evolutionary Computing (cs.NE)

[64] arXiv:2012.04231 (cross-list from cs.LG) [pdf, other]

Title: A Deep Generative Model for Molecule Optimization via One Fragment Modification

Ziqi Chen, Martin Renqiang Min, Srinivasan Parthasarathy, Xia Ning

Comments: This paper has been accepted by Nature Machine Intelligence

Journal-ref: Nat Mach Intell. 3 (2021) 1040-1049

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[65] arXiv:2012.04353 (cross-list from cs.LG) [pdf, other]

Title: Reinforcement Based Learning on Classification Task Could Yield Better Generalization and Adversarial Accuracy

Shashi Kant Gupta

Comments: 10 pages (5 main, 1 ref, 4 supplementary); Accepted at 2nd Workshop on Shared Visual Representations in Human and Machine Intelligence (SVRHM), NeurIPS 2020

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)

[66] arXiv:2012.04567 (cross-list from cs.CV) [pdf, other]

Title: Bayesian Image Reconstruction using Deep Generative Models

Razvan V Marinescu, Daniel Moyer, Polina Golland

Comments: 27 pages, 17 figures, 5 tables

Journal-ref: NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Image and Video Processing (eess.IV); Machine Learning (stat.ML)

[67] arXiv:2012.04700 (cross-list from cs.RO) [pdf, other]

Title: Emergence of Different Modes of Tool Use in a Reaching and Dragging Task

Khuong Nguyen, Yoonsuck Choe

Comments: 11 pages, 10 figures, 14 pdf-embedded animations

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[68] arXiv:2012.04926 (cross-list from cs.LG) [pdf, other]

Title: Improving Gradient Flow with Unrolled Highway Expectation Maximization

Chonghyuk Song, Eunseok Kim, Inwook Shim

Comments: Accepted at AAAI 2021. Preprint

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)

[69] arXiv:2012.04984 (cross-list from cs.ET) [pdf, other]

Title: Hybrid Quantum Computing -- Tabu Search Algorithm for Partitioning Problems: preliminary study on the Traveling Salesman Problem

Eneko Osaba, Esther Villar-Rodriguez, Izaskun Oregi, Aitor Moreno-Fernandez-de-Leceta

Comments: 8 pages, 4 figures, paper accepted in IEEE Congress on Evolutionary Computation 2021

Subjects: Emerging Technologies (cs.ET); Neural and Evolutionary Computing (cs.NE)

[70] arXiv:2012.05046 (cross-list from math.OC) [pdf, other]

Title: A multi-objective optimization framework for on-line ridesharing systems

Hamed Javidi, Dan Simon, Ling Zhu, Yan Wang

Subjects: Optimization and Control (math.OC); Discrete Mathematics (cs.DM); Neural and Evolutionary Computing (cs.NE); Systems and Control (eess.SY)

[71] arXiv:2012.05152 (cross-list from cs.LG) [pdf, other]

Title: Binding and Perspective Taking as Inference in a Generative Neural Network Model

Mahdi Sadeghi, Fabian Schrodt, Sebastian Otte, Martin V. Butz

Journal-ref: ICANN 2021 pp 3-14

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[72] arXiv:2012.05419 (cross-list from cs.AR) [pdf, other]

Title: A Custom 7nm CMOS Standard Cell Library for Implementing TNN-based Neuromorphic Processors

Harideep Nair, Prabhu Vellaisamy, Santha Bhasuthkar, John Paul Shen

Comments: This work is dated and will be superseded by a forthcoming work

Subjects: Hardware Architecture (cs.AR); Emerging Technologies (cs.ET); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[73] arXiv:2012.05705 (cross-list from cs.LG) [pdf, other]

Title: Automatic Micro-sleep Detection under Car-driving Simulation Environment using Night-sleep EEG

Young-Seok Kweon, Gi-Hwan Shin, Heon-Gyu Kwak, Minji Lee

Comments: Submitted IEEE The 9th International Winter Conference on Brain-Computer Interface

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[74] arXiv:2012.05959 (cross-list from cs.CV) [pdf, other]

Title: Super-resolution Guided Pore Detection for Fingerprint Recognition

Syeda Nyma Ferdous, Ali Dabouei, Jeremy Dawson, Nasser M Nasrabadi

Journal-ref: ICPR: International Conference on Pattern Recognition 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)

[75] arXiv:2012.06027 (cross-list from physics.comp-ph) [pdf, other]

Title: Comparison of Update and Genetic Training Algorithms in a Memristor Crossbar Perceptron

Kyle N. Edwards, Xiao Shen

Journal-ref: AIP Advances 12, 025327 (2022)

Subjects: Computational Physics (physics.comp-ph); Neural and Evolutionary Computing (cs.NE)

[76] arXiv:2012.06138 (cross-list from cs.LG) [pdf, other]

Title: AdvantageNAS: Efficient Neural Architecture Search with Credit Assignment

Rei Sato, Jun Sakuma, Youhei Akimoto

Comments: The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[77] arXiv:2012.06365 (cross-list from cs.LG) [pdf, other]

Title: Feature Selection Based on Sparse Neural Network Layer with Normalizing Constraints

Peter Bugata, Peter Drotar

Comments: in IEEE Transactions on Cybernetics

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)

[78] arXiv:2012.06373 (cross-list from cs.LG) [pdf, other]

Title: Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignment

Julien Launay, Iacopo Poli, Kilian Müller, Gustave Pariente, Igor Carron, Laurent Daudet, Florent Krzakala, Sylvain Gigan

Comments: 6 pages, 2 figures, 1 table. Oral at the Beyond Backpropagation Workshop, NeurIPS 2020

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Hardware Architecture (cs.AR); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[79] arXiv:2012.06694 (cross-list from cs.LG) [pdf, other]

Title: Consequences of Slow Neural Dynamics for Incremental Learning

Shima Rahimi Moghaddam, Fanjun Bu, Christopher J. Honey

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[80] arXiv:2012.06720 (cross-list from math.OC) [pdf, other]

Title: Low-Order Model of Biological Neural Networks

Huachuan Wang, James Ting-Ho Lo

Subjects: Optimization and Control (math.OC); Neural and Evolutionary Computing (cs.NE); Neurons and Cognition (q-bio.NC)

[81] arXiv:2012.06800 (cross-list from cs.LG) [pdf, other]

Title: Delay Differential Neural Networks

Srinivas Anumasa, P.K. Srijith

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)

[82] arXiv:2012.06908 (cross-list from cs.LG) [pdf, other]

Title: The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models

Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Yang Zhang, Michael Carbin, Zhangyang Wang

Comments: CVPR 2021

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)

[83] arXiv:2012.07458 (cross-list from eess.SY) [pdf, other]

Title: Lagrangian Reachtubes: The Next Generation

Sophie Gruenbacher, Jacek Cyranka, Mathias Lechner, Md. Ariful Islam, Scott A. Smolka, Radu Grosu

Comments: 12 pages, 14 figures

Journal-ref: Proceedings of the 59th IEEE Conference on Decision and Control (CDC), 2020, pages 1556-1563

Subjects: Systems and Control (eess.SY); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[84] arXiv:2012.07515 (cross-list from cs.CL) [pdf, other]

Title: Data-Driven Regular Expressions Evolution for Medical Text Classification Using Genetic Programming

J Liu, R Bai, Z Lu, P Ge, D Liu, Uwe Aickelin

Comments: 2020 IEEE Congress on Evolutionary Computation (CEC)

Subjects: Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)

[85] arXiv:2012.07564 (cross-list from cs.LG) [pdf, other]

Title: ALReLU: A different approach on Leaky ReLU activation function to improve Neural Networks Performance

Stamatis Mastromichalakis

Comments: 10 pages,4 figures,1 table,2 Listings-Python code snippets

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[86] arXiv:2012.07664 (cross-list from cs.LG) [pdf, other]

Title: Constraints on Hebbian and STDP learned weights of a spiking neuron

Dominique Chu, Huy Le Nguyen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[87] arXiv:2012.08180 (cross-list from cs.LG) [pdf, other]

Title: Squirrel: A Switching Hyperparameter Optimizer

Noor Awad, Gresa Shala, Difan Deng, Neeratyoy Mallik, Matthias Feurer, Katharina Eggensperger, Andre' Biedenkapp, Diederick Vermetten, Hao Wang, Carola Doerr, Marius Lindauer, Frank Hutter

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[88] arXiv:2012.08300 (cross-list from cs.LG) [pdf, other]

Title: BiSNN: Training Spiking Neural Networks with Binary Weights via Bayesian Learning

Hyeryung Jang, Nicolas Skatchkovsky, Osvaldo Simeone

Comments: Submitted

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Signal Processing (eess.SP)

[89] arXiv:2012.08403 (cross-list from cs.LG) [pdf, other]

Title: Artificial Neural Networks for Sensor Data Classification on Small Embedded Systems

Marcus Venzke, Daniel Klisch, Philipp Kubik, Asad Ali, Jesper Dell Missier, Volker Turau

Comments: 21 pages, 13 figures

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[90] arXiv:2012.08676 (cross-list from cs.LG) [pdf, other]

Title: Policy Manifold Search for Improving Diversity-based Neuroevolution

Nemanja Rakicevic, Antoine Cully, Petar Kormushev

Comments: Paper accepted as oral (8% acceptance rate) at Beyond Backpropagation: Novel Ideas for Training Neural Architectures Workshop at NeurIPS 2020

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[91] arXiv:2012.08858 (cross-list from cs.AI) [pdf, other]

Title: Lévy walks derived from a Bayesian decision-making model in non-stationary environments

Shuji Shinohara, Nobuhito Manome, Yoshihiro Nakajima, Yukio Pegio Gunji, Toru Moriyama, Hiroshi Okamoto, Shunji Mitsuyoshi, Ung-il Chung

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multiagent Systems (cs.MA); Neural and Evolutionary Computing (cs.NE)

[92] arXiv:2012.08859 (cross-list from cs.LG) [pdf, other]

Title: Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces

Bert Moons, Parham Noorzad, Andrii Skliar, Giovanni Mariani, Dushyant Mehta, Chris Lott, Tijmen Blankevoort

Comments: Accepted at ICCV2021. Main text 9 pages, Full text 21 pages, 18 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[93] arXiv:2012.08863 (cross-list from cs.LG) [pdf, other]

Title: On The Verification of Neural ODEs with Stochastic Guarantees

Sophie Gruenbacher, Ramin Hasani, Mathias Lechner, Jacek Cyranka, Scott A. Smolka, Radu Grosu

Comments: 12 pages, 2 figures

Journal-ref: Proceedings of the AAAI Conference on Artificial Intelligence, 35(13), 2021, pages 11525-11535

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Systems and Control (eess.SY)

[94] arXiv:2012.09243 (cross-list from cs.CV) [pdf, other]

Title: Neural Pruning via Growing Regularization

Huan Wang, Can Qin, Yulun Zhang, Yun Fu

Comments: Accepted by ICLR 2021

Journal-ref: International Conference on Learning Representations (ICLR) 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[95] arXiv:2012.09318 (cross-list from cs.AI) [pdf, other]

Title: Applying Deutsch's concept of good explanations to artificial intelligence and neuroscience -- an initial exploration

Daniel C. Elton

Comments: Accepted for a talk at BICA 2020 and for publication in Cognitive Systems Research

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[96] arXiv:2012.09444 (cross-list from cs.CV) [pdf, other]

Title: Learning and Sharing: A Multitask Genetic Programming Approach to Image Feature Learning

Ying Bi, Bing Xue, Mengjie Zhang

Comments: Submitted to IEEE Transactions on Evolutionary Computation

Journal-ref: IEEE Transactions on Evolutionary Computation, 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)

[97] arXiv:2012.09542 (cross-list from cs.CV) [pdf, other]

Title: Weakly-Supervised Action Localization and Action Recognition using Global-Local Attention of 3D CNN

Novanto Yudistira, Muthu Subash Kavitha, Takio Kurita

Journal-ref: International Journal of Computer Vision, 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[98] arXiv:2012.09605 (cross-list from cs.LG) [pdf, other]

Title: Sparsifying networks by traversing Geodesics

Guruprasad Raghavan, Matt Thomson

Comments: 5 pages; Presented work at NeurIPS 2020 Workshop (DiffGeo4DL). arXiv admin note: text overlap with arXiv:2005.11603

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Differential Geometry (math.DG)

[99] arXiv:2012.09816 (cross-list from cs.LG) [pdf, other]

Title: Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning

Zeyuan Allen-Zhu, Yuanzhi Li

Comments: v2/V3 polishes writing

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Optimization and Control (math.OC); Machine Learning (stat.ML)

[100] arXiv:2012.09823 (cross-list from cs.CL) [pdf, other]

Title: Continual Lifelong Learning in Natural Language Processing: A Survey

Magdalena Biesialska, Katarzyna Biesialska, Marta R. Costa-jussà

Comments: COLING 2020

Journal-ref: Proceedings of the 28th International Conference on Computational Linguistics (COLING 2020), Barcelona, Spain (Online), pp. 6523--6541

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)