Models

OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc

11B • Updated Apr 24, 2025 • 6 • 1

bartowski/Llama-3.3-70B-Instruct-exl2

Text Generation • Updated Dec 20, 2024 • 24 • 3

etemiz/Llama-3.1-70B-Instruct-GGUF

71B • Updated Dec 19, 2024 • 43

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16

Text Generation • 11B • Updated Jan 3, 2025 • 4

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8

Text Generation • 71B • Updated Jan 3, 2025 • 3

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 4

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 4

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 29

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 6

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 56

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 2

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 9

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 3

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 10

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 10

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 5

tensorblock/Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 9, 2025 • 90

context-labs/neuralmagic-llama-3.1-70b-instruct-FP8

Text Generation • 71B • Updated Feb 24, 2025 • 21

necva/replicate-IEPile-Llama3.1-70B

73B • Updated Mar 10, 2025 • 4

necva/replica-IEPile-Llama3.1-70B

73B • Updated Mar 10, 2025 • 4

turboderp/Llama-3.1-70B-Instruct-exl3

Updated Nov 1, 2025 • 28 • 1

jusjinuk/Llama-3.1-70B-Instruct-2bit-GuidedQuant-QTIP

11B • Updated Jun 19, 2025 • 5

jusjinuk/Llama-3.1-70B-Instruct-3bit-GuidedQuant-QTIP

15B • Updated Jun 19, 2025 • 5

jusjinuk/Llama-3.1-70B-Instruct-4bit-GuidedQuant-QTIP

19B • Updated Jun 19, 2025 • 4

RedHatAI/Llama-3.1-70B-Instruct-NVFP4

Text Generation • 41B • Updated Nov 21, 2025 • 841

RedHatAI/Llama-3.1-70B-Instruct-NVFP4A16

Text Generation • 41B • Updated Jun 30, 2025 • 3

Hyun9junn/Llama-3.1-70B-Instruct-W4A4KV4-FlatQuant

36B • Updated Sep 30, 2025 • 5

TevunahAi/Llama-3.1-70B-Instruct-Ultra-Hybrid

Text Generation • 22B • Updated Dec 4, 2025 • 3

sh0ck0r/llama-3.1-70b-instruct-FP8-Dynamic

Text Generation • 71B • Updated 16 days ago • 8

cyborgwittgenstein/cassie-70b-v6-gguf

71B • Updated 11 days ago • 23