| license: gpl | |
| usage: https://github.com/CarperAI/trlx/blob/3396bf118869cd823b6909e082caf3810d8989e0/examples/nemo_ilql_inference.py | |
| edit above file and below config to have `num_nodes = 2` and `devices = 8` | |
| ``` | |
| python trlx/examples/nemo_ilql_inference.py trlx/configs/nemo_configs/megatron_65b.yaml "/path/to/checkpoints" | |
| ``` |