merging
3 notes tagged “merging”
-
[MCTF] Multi-criteria Token Fusion with One-step-ahead Attention for Efficient Vision Transformers
Fuses tokens by a product of three criteria — similarity, informativeness, size — with one-step-ahead attention and bidirectional bipartite matching, beating the base model while cutting FLOPs.
-
[DTEM] Learning to Merge Tokens via Decoupled Embedding for Efficient Vision Transformers
Learns a lightweight embedding dedicated to merging — decoupled from the ViT forward pass — via a continuously relaxed (differentiable) token merging.
-
[ToMe] Token Merging: Your ViT But Faster
Combine similar tokens (not prune) via bipartite soft matching, fast as pruning, works even without training.
