triton-layer-norm / torch-ext

Commit History

Make `RMSNorm` layer pure, rename to `LlamaRMSNorm`
4a07eb0

danieldk HF Staff commited on

black
15057d1

danieldk HF Staff commited on

Use `torch.amp` rather than deprecated `torch.cuda.amp`
02598b2

danieldk HF Staff commited on

Move `RMSNorm` to `layers`
02bea52

danieldk HF Staff commited on

Add Triton-based layer norm from flash-attention
0f75957

danieldk HF Staff commited on