File size: 335 Bytes
8f865f6 01c6a8f 74ca5bf 8b3eec7 74ca5bf 6723fba 74ca5bf |
1 2 3 4 5 6 7 8 9 10 11 |
---
license: gpl
---
usage: https://github.com/CarperAI/trlx/blob/3396bf118869cd823b6909e082caf3810d8989e0/examples/nemo_ilql_inference.py
edit above file and below config to have `num_nodes = 2` and `devices = 8`
```
python trlx/examples/nemo_ilql_inference.py trlx/configs/nemo_configs/megatron_65b.yaml "/path/to/checkpoints"
``` |