Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

807

Base only

Active filters: ggml

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 304k • 510

realrebelai/LingBot-30B-3B_GGUF_ComfyUI

Text-to-Video • 30B • Updated 4 days ago • 3.43k • 11

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 152k • 181

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 47.2k • 233

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated May 11 • 63.3k • 26

mudler/parakeet-cpp-gguf

Automatic Speech Recognition • 0.6B • Updated Jun 6 • 20.6k • 61

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 106k • 272

mudler/moss-transcribe.cpp-gguf

Automatic Speech Recognition • 0.9B • Updated 8 days ago • 777 • 4

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 15k • 72

unsloth/LTX-2-GGUF

Image-to-Video • 19B • Updated Jan 22 • 5.04k • 133

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 6.25k • 225

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 43.8k • 36

cstr/MOSS-Audio-4B-Instruct-GGUF

Audio-Text-to-Text • 5B • Updated Jun 5 • 541 • 4

mudler/voice-detect-gguf

0.3B • Updated 14 days ago • 5.37k • 2

Zyphra/ZONOS1-GGUF

Text-to-Speech • 63.5M • Updated 1 day ago • 93 • 2

malteos/bloom-6b4-clp-german

Text Generation • 6B • Updated Apr 6, 2024 • 78 • 38

unsloth/Qwen-Image-Layered-GGUF

Image-Text-to-Image • 20B • Updated Jan 9 • 12.5k • 59

unsloth/Qwen-Image-Edit-GGUF

Image-to-Image • 20B • Updated Dec 22, 2025 • 2.84k • 28

unsloth/FLUX.2-klein-base-4B-GGUF

Image-to-Image • 4B • Updated Jan 15 • 3.47k • 23

unsloth/FLUX.2-klein-base-9B-GGUF

Image-to-Image • 9B • Updated Jan 15 • 9k • 37

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 10.3k • 185

bleckhert/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Mar 21 • 1.61k • 1

continuum-ai/qwen3.5-4b-code-forged

Text Generation • 4B • Updated Apr 11 • 102 • 1

cstr/parakeet_de_med-GGUF

Automatic Speech Recognition • 0.6B • Updated 5 days ago • 321 • 1

cstr/qwen3-asr-0.6b-GGUF

Automatic Speech Recognition • 0.9B • Updated 7 days ago • 3.06k • 2

Pomni/whisper-large-v3-russian-ggml-allquants

Automatic Speech Recognition • Updated Apr 11 • 1

cstr/glm-asr-nano-GGUF

Automatic Speech Recognition • 2B • Updated 7 days ago • 3.02k • 2

cstr/mega-asr-GGUF

Automatic Speech Recognition • 2B • Updated 14 days ago • 1.43k • 2

cstr/pocket-tts-GGUF

Text-to-Speech • 0.1B • Updated 5 days ago • 647 • 1

FunAudioLLM/SenseVoiceSmall-GGUF

Automatic Speech Recognition • 0.2B • Updated 25 days ago • 4.7k • 5