unsloth/Qwen3-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 17.5k • 76

Note Modern and supports thinking

google/gemma-3-4b-it-qat-q4_0-gguf

Image-Text-to-Text • 4B • Updated Apr 11 • 9.79k • 218

Note Vision

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 107k • 128

Note Old but gold

NousResearch/Hermes-3-Llama-3.2-3B-GGUF

3B • Updated Dec 18, 2024 • 1.19k • 57

Note Great for simple tasks

openbmb/MiniCPM-V-2_6-gguf

8B • Updated Feb 27 • 4k • 172

Note Multimodal beast

Menlo/Jan-nano-128k-gguf

Text Generation • 4B • Updated Jul 1 • 8.9k • 70

Note Great for deep research type of usecases

vikhyatk/moondream2

Image-Text-to-Text • 2B • Updated Sep 23 • 1.69M • 1.35k

Note All in one solution for vision

unsloth/orpheus-3b-0.1-ft-GGUF

Text-to-Speech • 3B • Updated Jul 9 • 5.17k • 9

Note Good TTS, supports emotion tags, easy to finetune

nvidia/parakeet-tdt-0.6b-v2

Automatic Speech Recognition • Updated 10 days ago • 879k • 1.38k

Note Great STT for its size