Spaces:

Duplicated from hf-accelerate/model-memory-usage

andstor
/

deepspeed-model-memory-usage

Sleeping

App Files Files Community

deepspeed-model-memory-usage / src /parallelism_utils.py

Commit History

Update src/parallelism_utils.py

6ca6353
verified

andstor commited on Feb 8, 2024

Update calculations

964360b

andstor commited on Feb 5, 2024

Add DeepSpeed ZeRO calculations

674c962

andstor commited on Feb 2, 2024