Showing 1–1 of 1 results for author: Kopp, M

A remark on a paper of Krotov and Hopfield [arXiv:2008.06996]

Authors: Fei Tang, Michael Kopp

Abstract: In their recent paper titled "Large Associative Memory Problem in Neurobiology and Machine Learning" [arXiv:2008.06996] the authors gave a biologically plausible microscopic theory from which one can recover many dense associative memory models discussed in the literature. We show that the layers of the recent "MLP-mixer" [arXiv:2105.01601] as well as the essentially equivalent model in [arXiv:210… ▽ More In their recent paper titled "Large Associative Memory Problem in Neurobiology and Machine Learning" [arXiv:2008.06996] the authors gave a biologically plausible microscopic theory from which one can recover many dense associative memory models discussed in the literature. We show that the layers of the recent "MLP-mixer" [arXiv:2105.01601] as well as the essentially equivalent model in [arXiv:2105.02723] are amongst them. △ Less

Submitted 3 June, 2021; v1 submitted 31 May, 2021; originally announced May 2021.

Comments: 1 page, 8 formulae