Inference Providers
Active filters: 3-bit
unsloth/gemma-4-31b-it-UD-MLX-3bit
Image-Text-to-Text
• 31B • Updated • 51
• 5
unsloth/gemma-4-26b-a4b-it-UD-MLX-3bit
Image-Text-to-Text
• 25B • Updated • 130
• 5
Brooooooklyn/Qwen3.5-27B-unsloth-mlx
Text Generation
• 6B • Updated • 3.66k
• 15
NapYang/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-text-oQ3.5
Text Generation
• 27B • Updated • 2.44k
• 4
Brooooooklyn/Qwen3.5-35B-A3B-UD-Q4_K_XL-mlx
Text Generation
• 7B • Updated • 863
• 5
Brooooooklyn/Qwen3.5-35B-A3B-UD-Q6_K_XL-mlx
Text Generation
• 9B • Updated • 349
• 3
MaziyarPanahi/BioMistral-7B-GGUF
Text Generation
• 7B • Updated • 3.4k
• 58
MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 110k
• 102
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
• 7B • Updated • 122k
• 134
MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF
Text Generation
• 8B • Updated • 493
• 7
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 196k
• 34
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
Text Generation
• 4B • Updated • 456k
• 27
MaziyarPanahi/Qwen3-0.6B-GGUF
Text Generation
• 0.8B • Updated • 172k
• 11
MaziyarPanahi/Qwen3-14B-GGUF
Text Generation
• 15B • Updated • 170k
• 9
MaziyarPanahi/GLM-4.6V-Flash-GGUF
Text Generation
• 9B • Updated • 61.4k
• 4
MoringLabs/Nemotron-3-Super-120B-A12B-MLX-3.6bit
Text Generation
• 121B • Updated • 1.37k
• 2
Brooooooklyn/Qwen3.5-9B-unsloth-mlx
Text Generation
• 2B • Updated • 2.86k
• 10
DeathGodlike/Crownelius_Crow-9B-HERETIC-4.6_EXL3
Text Generation
• Updated • 12
• 1
NapYang/Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-text-oQ3.5
5B • Updated • 649
• 1
adam-fleet/Qwen3-Next-80B-A3B-Instruct-REAM-mlx-3bit
Text Generation
• 60B • Updated • 145
• 1
Brooooooklyn/Qwen3.5-35B-A3B-UD-Q3_K_XL-mlx
Text Generation
• 6B • Updated • 356
• 1
Brooooooklyn/Qwen3.5-35B-A3B-UD-Q5_K_XL-mlx
Text Generation
• 8B • Updated • 502
• 2
Brooooooklyn/Qwen3.5-35B-A3B-UD-Q8_K_XL-mlx
Text Generation
• 10B • Updated • 276
• 2
RepublicOfKorokke/GLM-4.7-Flash-oQ3.5
Text Generation
• 4B • Updated • 328
• 1
kaitchup/Llama-2-7b-gptq-3bit
Text Generation
• Updated • 18
clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 8
• 3
clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 3
• 3
MiNeves-tops/opt-125m-gptq-3bit
Text Generation
• Updated • 4
Text Generation
• Updated • 7
LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2
Text Generation
• Updated • 4