Mungert
/

granite-guardian-3.0-8b-GGUF

Text Generation

Model card Files Files and versions

granite-guardian-3.0-8b-GGUF

146 GB

1 contributor

History: 1 commit

Mungert's picture

Super-squash history to reclaim storage

0e4b225 verified 3 months ago

.gitattributes

4.54 kB

Super-squash history to reclaim storage 3 months ago
README.md

23.4 kB

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-bf16.gguf

16.3 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-bf16_q8_0.gguf

11.6 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-f16_q8_0.gguf

11.6 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-iq2_m.gguf

2.94 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-iq2_s.gguf

2.79 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-iq2_xs.gguf

2.69 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-iq2_xxs.gguf

2.46 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-iq3_m.gguf

3.82 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-iq3_s.gguf

3.82 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-iq3_xs.gguf

3.42 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-iq3_xxs.gguf

3.32 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-iq4_nl.gguf

4.67 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-iq4_xs.gguf

4.43 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q2_k_m.gguf

3.06 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q2_k_s.gguf

3.03 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q3_k_m.gguf

3.97 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q3_k_s.gguf

3.94 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q4_0.gguf

4.6 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q4_1.gguf

5.11 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q4_k_m.gguf

4.9 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q4_k_s.gguf

4.73 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q5_0.gguf

5.62 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q5_1.gguf

6.13 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q5_k_m.gguf

5.82 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q5_k_s.gguf

5.73 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q6_k_m.gguf

6.71 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b-q8_0.gguf

8.68 GB
xet

Super-squash history to reclaim storage 3 months ago
granite-guardian-3.0-8b.imatrix

5.99 MB
xet

Super-squash history to reclaim storage 3 months ago