wanted to say "wild they just drop this in a HF readme and not in a paper" but there is a paper. not labeled as theirs, hm
ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within LLMs
as usual Main was there 1st