Original article: On the Relationship between Self-Attention and Convolutional Layers by Jean-Baptiste Cordonnier, Andreas Loukas & Martin Jaggi, in proceedings of ICML 2020.

PDF URL: Reproducibility report
Metadata URL: Metadata
Code URL: Code

Scientific domain: Deep Learning
Programming language: Python
Suggested editor: Nicolas P. Rougier (@rougier)

Dear all,
This is a reproduction of the paper mentioned above, written with Mukund Varma (@MukundVarmaT). The paper discusses the use of transformers and self-attention for vision tasks. We suggest Nicolas P. Rougier as the editor.

With warm regards,
Nishant Prabhu