One-Cycle Structured Pruning via Stability-Driven Subnetwork Search
Published in The IEEE/CVF Winter Conference on Applications of Computer Vision 2026 (WACV), 2025
The key idea is to identify the optimal sub-network early in training, guided by norm-based group saliency criteria and structured sparsity regularization. We further introduce a novel pruning indicator that determines the stable pruning epoch by measuring the similarity between evolving sub-networks across consecutive epochs. The group sparsity regularization accelerates pruning, further reducing training time.