[NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity
-
Updated
Mar 16, 2024 - Python
#
linear-transformer
Here are 3 public repositories matching this topic...
This repo contains the source code of the first deep learning-base singing voice beat tracking system. It leverages WavLM and DistilHuBERT pre-trained speech models to create vocal embeddings and trains linear multi-head self-attention layers on top of them to extract vocal beat activations. Then, it uses HMM decoder to infer signing beats and t…
music
music-information-retrieval
beat-tracking
self-supervised
singing-voice
hubert
linear-transformer
wavlm
-
Updated
Sep 4, 2022 - Python
Polynormer: Polynomial-Expressive Graph Transformer in Linear Time
graph-neural-network
graph-transfomer
linear-transformer
homophilic-and-heterophilic-graphs
polynomial-network
-
Updated
Apr 6, 2024 - Python
Improve this page
Add a description, image, and links to the linear-transformer topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the linear-transformer topic, visit your repo's landing page and select "manage topics."