pruning
10 notes tagged “pruning”
-
[Token Cropr] Token Cropr: Faster ViTs for Quite a Few Tasks
Prunes tokens by task relevance using auxiliary cross-attention heads that are thrown away after training, plus Last Layer Fusion to revive pruned tokens for dense tasks.
-
[Frequency-Aware TR] Frequency-Aware Token Reduction for Efficient Vision Transformer
Reads token reduction through a frequency lens: keeps high-frequency tokens (which fight rank collapse) and squeezes the low-frequency rest into a compact DC token.
-
[STAR] Synergistic Patch Pruning for Vision Transformer: Unifying Intra- & Inter-Layer Patch Importance
Fuses online intra-layer [CLS] attention with offline inter-layer LRP importance, and auto-tunes per-layer retention rates from patch similarity.
-
[Zero-TPrune] Zero-Shot Token Pruning through Leveraging of the Attention Graph in Pre-Trained Transformers
Treats the attention matrix as a directed graph and ranks tokens with a Weighted PageRank — pruning without any fine-tuning.
-
[TPS] Joint Token Pruning & Squeezing Towards More Aggressive Compression of Vision Transformers
Instead of throwing pruned tokens away, squeezes their information into the surviving 'host' tokens — parameter-free matching + similarity-based fusing.
-
[AS-ViT] Adaptive Sparse ViT: Learnable Adaptive Token Pruning by Fully Exploiting Self-Attention
Learnable thresholds replace fixed keep-ratios, scoring tokens for free from MHSA's own intermediate results.
-
[ATS] Adaptive Token Sampling for Efficient Vision Transformers
Parameter-free, picks a variable number of tokens per image by sampling the attention CDF.
-
[Evo-ViT] Slow-Fast Token Evolution for Dynamic Vision Transformer
Keep all tokens but update informative vs placeholder tokens on different paths.
-
[EViT] Not All Patches Are What You Need: Expediting ViTs via Token Reorganizations
Keep top-k attentive tokens by CLS attention, fuse the rest into one.
-
[DynamicViT] Efficient Vision Transformers with Dynamic Token Sparsification
Dynamically drops redundant tokens per input to speed up ViTs.
