An implementation of Variance Pruning: Pruning Language Models via Temporal Neuron Variance by Berry Weinstein, Yonatan Belinkov. Link
Implementation of pruning class is in main_pruning_code.py. Sample implementation on the pytorch CIFAR-10 tutorial is in cifar10_tutorial.ipynb
https://www.johndcook.com/blog/standard_deviation/ for the running mean and variance logic