pytorch
/

Qwen3-4B-INT8-INT4

Text Generation

text-generation-inference

Model card Files Files and versions

metascroy commited on May 14

Commit

c1d2eed

·

verified ·

1 Parent(s): abf94ff

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -209,7 +209,7 @@ Once ExecuTorch is [set-up](https://pytorch.org/executorch/main/getting-started.
 We first convert the [quantized checkpoint](https://huggingface.co/pytorch/Qwen3-4B-8da4w/blob/main/pytorch_model.bin) to one ExecuTorch's LLM export script expects by renaming some of the checkpoint keys.
 The following script does this for you.  We have uploaded the converted checkpoint [pytorch_model_converted.bin](https://huggingface.co/pytorch/Qwen3-4B-8da4w/blob/main/pytorch_model_converted.bin) for convenience.
 ```Shell
-python -m executorch.examples.models.qwen3.convert_weights pytorch_model.bin pytorch_model_converted.bin
 ```
 Once the checkpoint is converted, we can export to ExecuTorch's pte format with the XNNPACK delegate.

 We first convert the [quantized checkpoint](https://huggingface.co/pytorch/Qwen3-4B-8da4w/blob/main/pytorch_model.bin) to one ExecuTorch's LLM export script expects by renaming some of the checkpoint keys.
 The following script does this for you.  We have uploaded the converted checkpoint [pytorch_model_converted.bin](https://huggingface.co/pytorch/Qwen3-4B-8da4w/blob/main/pytorch_model_converted.bin) for convenience.
 ```Shell
+python -m executorch.examples.models.qwen3.convert_weights $(huggingface-cli download pytorch/Qwen3-4B-8da4w) pytorch_model_converted.bin
 ```
 Once the checkpoint is converted, we can export to ExecuTorch's pte format with the XNNPACK delegate.