TorchAO quantized Qwen3 models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch
pytorch
non-profit
AI & ML interests
An open source machine learning framework that accelerates the path from research prototyping to production deployment.
Recent Activity
View all activity
TorchAO quantized Phi-4-mini-instruct models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch
-
pytorch/Phi-4-mini-instruct-INT4
Text Generation β’ Updated β’ 357 -
pytorch/Phi-4-mini-instruct-FP8
Text Generation β’ Updated β’ 587 β’ 1 -
pytorch/Phi-4-mini-instruct-INT8-INT4
Text Generation β’ Updated β’ 1.48k β’ 2 -
pytorch/Phi-4-mini-instruct-AWQ-INT4
Text Generation β’ Updated β’ 627 β’ 3
TorchAO quantized Qwen3 models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch
TorchAO quantized Phi-4-mini-instruct models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch
-
pytorch/Phi-4-mini-instruct-INT4
Text Generation β’ Updated β’ 357 -
pytorch/Phi-4-mini-instruct-FP8
Text Generation β’ Updated β’ 587 β’ 1 -
pytorch/Phi-4-mini-instruct-INT8-INT4
Text Generation β’ Updated β’ 1.48k β’ 2 -
pytorch/Phi-4-mini-instruct-AWQ-INT4
Text Generation β’ Updated β’ 627 β’ 3