Spaces:

nanotron
/

ultrascale-playbook

Running

App Files Files Community

Resources

View closed (91)

Questions?

#84 opened 21 days ago by

More ressources

#73 opened 23 days ago by

A mistake ? Weights/grads/optimizer stats memory for mixed precision

#104 opened 2 days ago by

Questions about pipeline parallelism

#103 opened 3 days ago by

update

#102 opened 3 days ago by

Widget does not take TP into account for Parameter / Gradient / Optimizer State Sharding

#98 opened 12 days ago by

Am I misunderstanding Zero-1 and Zero-2?

#94 opened 13 days ago by

Fix description of Zero-1

#93 opened 13 days ago by

Few Errors

#86 opened 20 days ago by

How can the following figure be obtained, and is there a way to tag the name of each tensor during profiling?

#83 opened 22 days ago by

dark-mode

#82 opened 23 days ago by

Thanks for sharing. Was looking for similar research to get to know about compute(AI+GPU)

#79 opened 23 days ago by

Make it easier to import into reader applications

#77 opened 23 days ago by