Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31,174

Base only

Active filters: 8-bit

deepseek-ai/DeepSeek-V4-Pro-DSpark

Text Generation • 889B • Updated 6 days ago • 29.2k • 459

nvidia/Qwen3.6-27B-NVFP4

Text Generation • 18B • Updated 10 days ago • 748k • 333

nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4

Text Generation • 45B • Updated 3 days ago • 17k • 90

deepseek-ai/DeepSeek-V4-Flash-DSpark

Text Generation • 165B • Updated 6 days ago • 118k • 182

nvidia/GLM-5.2-NVFP4

Text Generation • 381B • Updated 13 days ago • 626k • 258

deepseek-ai/DeepSeek-V4-Pro

Text Generation • 862B • Updated 18 days ago • 1.29M • • 5.19k

madeby561/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid

347B • Updated about 11 hours ago • 875 • 35

deepseek-ai/DeepSeek-V4-Flash

Text Generation • 158B • Updated 18 days ago • 2.48M • • 1.72k

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated 27 days ago • 8M • 452

openai/gpt-oss-120b

Text Generation • 120B • Updated Aug 26, 2025 • 4.43M • • 4.96k

AEON-7/Ornith-1.0-35B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 21B • Updated 11 days ago • 37.1k • 49

openai/gpt-oss-20b

Text Generation • 22B • Updated Aug 26, 2025 • 7.34M • • 4.78k

RedHatAI/GLM-5.2-NVFP4-FP8

Text Generation • 425B • Updated about 13 hours ago • 436 • 16

sakamakismile/ThinkingCap-Qwen3.6-27B-NVFP4

Image-Text-to-Text • 17B • Updated 2 days ago • 313 • 14

meituan-longcat/LongCat-2.0-INT8

Text Generation • 1.8T • Updated 2 days ago • 171 • 13

google/gemma-4-E2B-it-qat-mobile-transformers

Any-to-Any • 2B • Updated Jun 5 • 25.2k • 120

PhalaCloud/GLM-5.2-W4AFP8

Text Generation • 392B • Updated 2 days ago • 31.9k • 35

nvidia/Qwen3.5-122B-A10B-NVFP4

Text Generation • 65B • Updated Jun 2 • 98.4k • 38

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4

Text Generation • 335B • Updated 15 days ago • 435k • • 245

nvidia/MiniMax-M3-NVFP4

Text Generation • 247B • Updated 14 days ago • 127k • 58

kodelow/Hy3-NVFP4-W4A16

Text Generation • 172B • Updated 2 days ago • 3.08k • 10

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

Text Generation • 67B • Updated May 1 • 1.43M • 384

nvidia/DeepSeek-V4-Flash-NVFP4

Text Generation • 167B • Updated 25 days ago • 663k • 64

nvidia/diffusiongemma-26B-A4B-it-NVFP4

Text Generation • 14B • Updated 5 days ago • 1.92M • 98

nvidia/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 11 • 1.96M • 114

OpenYourMind/GLM-5.2-abliterated

432B • Updated 11 days ago • 2 • 24

rdtand/Ornith-1.0-35B-PrismaAURA-4.75bit-vllm-MTP

Text Generation • 22B • Updated 5 days ago • 2.59k • 6

microsoft/bitnet-b1.58-2B-4T

Text Generation • 0.8B • Updated Dec 17, 2025 • 9.25k • 1.48k

mlx-community/gemma-4-12b-coder-fable5-composer2.5-8bit

Text Generation • 12B • Updated 19 days ago • 12.8k • 24

RedHatAI/GLM-5.2-NVFP4

Text Generation • 426B • Updated 10 days ago • 316 • 6