Qwen3-VisionCaption-2B-GGUF

Qwen3-VisionCaption-2B is an abliterated v1.0 variant fine-tuned by prithivMLmods from Qwen3-VL-2B-Instruct-abliterated-v1, specifically engineered for seamless, high-precision image captioning and uncensored visual analysis across diverse multimodal contexts including complex scenes, artistic content, technical diagrams, and sensitive imagery. It bypasses conventional content filters to deliver robust, factual, and richly descriptive captions with deep reasoning, spatial awareness, multilingual OCR support (32 languages), and handling of varied aspect ratios while maintaining the base model's 256K token long-context capacity for comprehensive visual understanding. Ideal for research in content moderation, red-teaming, dataset annotation, creative applications, and generative safety evaluation, the model produces detailed outputs suitable for accessibility tools, storytelling, and vision-language tasks on edge devices via efficient inference frameworks like Transformers.

Qwen3-VisionCaption-2B [GGUF]

File Name	Quant Type	File Size	File Link
Qwen3-VisionCaption-2B.BF16.gguf	BF16	3.45 GB	Download
Qwen3-VisionCaption-2B.F16.gguf	F16	3.45 GB	Download
Qwen3-VisionCaption-2B.F32.gguf	F32	6.89 GB	Download
Qwen3-VisionCaption-2B.Q8_0.gguf	Q8_0	1.83 GB	Download
Qwen3-VisionCaption-2B.mmproj-bf16.gguf	mmproj-bf16	823 MB	Download
Qwen3-VisionCaption-2B.mmproj-f16.gguf	mmproj-f16	819 MB	Download
Qwen3-VisionCaption-2B.mmproj-f32.gguf	mmproj-f32	1.63 GB	Download
Qwen3-VisionCaption-2B.mmproj-q8_0.gguf	mmproj-q8_0	445 MB	Download

Run with llama.cpp on Jan, Ollama, LM Studio, and other platforms.

Preview 1	Preview 2

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):