TorchAO quantized Qwen3 models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch
pytorch
non-profit
AI & ML interests
An open source machine learning framework that accelerates the path from research prototyping to production deployment.
Recent Activity
View all activity
Organization Card
Hugging Face ๐ค + PyTorch ๐ฅ
models
9

pytorch/Qwen3-8B-INT4
Text Generation
โข
Updated
โข
149
โข
2

pytorch/Qwen3-8B-AWQ-INT4
Text Generation
โข
Updated
โข
31

pytorch/Phi-4-mini-instruct-AWQ-INT4
Text Generation
โข
Updated
โข
9

pytorch/Phi-4-mini-instruct-FP8
Text Generation
โข
Updated
โข
1.14k
โข
1

pytorch/Phi-4-mini-instruct-INT4
Text Generation
โข
Updated
โข
1.13k

pytorch/Qwen3-32B-FP8
Text Generation
โข
Updated
โข
42

pytorch/SmolLM3-3B-INT8-INT4
Text Generation
โข
Updated
โข
120
โข
35

pytorch/Phi-4-mini-instruct-INT8-INT4
Text Generation
โข
Updated
โข
1.18k
โข
1

pytorch/Qwen3-4B-INT8-INT4
Text Generation
โข
Updated
โข
70
โข
1
datasets
0
None public yet