linear-transformer topic

[NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity

fudan-zvg

This repo contains the source code of the first deep learning-base singing voice beat tracking system. It leverages WavLM and DistilHuBERT pre-trained speech models to create vocal embeddings and trai...

mjhydri

Polynormer: Polynomial-Expressive Graph Transformer in Linear Time

cornell-zhang

Implementation for MatMul-free LM.

ridgerchu