Inference Providers
Active filters: 8bit
TheCluster/Darwin-35B-A3B-Opus-MLX-mxfp8
Image-Text-to-Text
• 35B • Updated • 144
• 10
mlx-community/Qwen3.6-27B-OptiQ-4bit
Text Generation
• 27B • Updated • 1.57k
• 5
FabioSarracino/VibeVoice-Large-Q8
Text-to-Audio
• 9B • Updated • 1.09k
• 97
mlx-community/Qwen3.5-9B-MLX-8bit
3B • Updated • 2.61k
• 8
mlx-community/Qwen3.5-0.8B-OptiQ-4bit
Text Generation
• 0.2B • Updated • 6.96k
• 16
mlx-community/Qwen3.5-4B-OptiQ-4bit
Text Generation
• 0.8B • Updated • 4.98k
• 11
mlx-community/gemma-4-e2b-it-OptiQ-4bit
Text Generation
• 1B • Updated • 1.2k
• 2
mlx-community/gemma-4-e4b-it-OptiQ-4bit
Text Generation
• 8B • Updated • 4.07k
• 10
mlx-community/Qwen3.5-0.8B-MLX-8bit
0.3B • Updated • 2.06k
• 4
mlx-community/Qwen3.5-2B-MLX-8bit
0.9B • Updated • 3.25k
• 6
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation
• 9B • Updated • 73.3k
• 34
jwindle47/chandra-ocr-2-8bit-mlx
Image-Text-to-Text
• 2B • Updated • 476
• 1
mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit
Text Generation
• 25B • Updated • 365
• 1
mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit
Text Generation
• 35B • Updated • 318
• 1
GiaHuy/Darwin-36B-Opus-mlx-text-only-8bit
Text Generation
• 35B • Updated • 54
• 1
mlx-community/Qwen3.5-2B-OptiQ-4bit
Text Generation
• 0.4B • Updated • 4.99k
• 7
SuperPauly/Gemmasutra_LiteRT-LM
Text Generation
• Updated • 7
crumb/gpt-j-6b-finetune-super-glue
Text Generation
• Updated • 9
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
• 6B • Updated • 14
• 7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
• 6B • Updated • 17
• 4
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
• Updated • 28
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
• Updated • 15
• 4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
• 3B • Updated • 14
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation
• Updated • 12
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation
• Updated • 6
• 1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation
• 7B • Updated • 16
• 7
Trelis/mpt-7b-instruct-hosted-inference-8bit
Text Generation
• Updated • 14
ecastera/eva-mistral-catmacaroni-7b-spanish
Text Generation
• 7B • Updated • 46
• 3
ecastera/eva-mistral-turdus-7b-spanish
Text Generation
• 7B • Updated • 7
ecastera/eva-mistral-7b-spanish-GGUF
7B • Updated • 101
• 9