Michael Han's picture

Michael Han

shimmyshimmer

·

https://unsloth.ai

AI & ML interests

None yet

Recent Activity

new activity 1 day ago

unsloth/Ministral-3-14B-Instruct-2512-GGUF:Examples of how to include an image in the input using a URL and using base64.

reacted to danielhanchen's post with 🚀 2 days ago

Mistral's new Ministral 3 models can now be Run & Fine-tuned locally! (16GB RAM) Ministral 3 have vision support and the best-in-class performance for their sizes. 14B Instruct GGUF: https://huggingface.co/unsloth/Ministral-3-14B-Instruct-2512-GGUF 14B Reasoning GGUF: https://huggingface.co/unsloth/Ministral-3-14B-Reasoning-2512-GGUF 🐱 Step-by-step Guide: https://docs.unsloth.ai/new/ministral-3 All GGUFs, BnB, FP8 etc. variants uploads: https://huggingface.co/collections/unsloth/ministral-3

reacted to danielhanchen's post with ❤️ 2 days ago

Mistral's new Ministral 3 models can now be Run & Fine-tuned locally! (16GB RAM) Ministral 3 have vision support and the best-in-class performance for their sizes. 14B Instruct GGUF: https://huggingface.co/unsloth/Ministral-3-14B-Instruct-2512-GGUF 14B Reasoning GGUF: https://huggingface.co/unsloth/Ministral-3-14B-Reasoning-2512-GGUF 🐱 Step-by-step Guide: https://docs.unsloth.ai/new/ministral-3 All GGUFs, BnB, FP8 etc. variants uploads: https://huggingface.co/collections/unsloth/ministral-3

View all activity

Organizations

upvoted a collection about 1 month ago

Qwen3-VL

Qwen's new multimodal vision models in GGUF, safetensor, and dynamic Unsloth formats. • 56 items • Updated 4 days ago • 17

upvoted a collection 2 months ago

DeepSeek-V3.2

4 items • Updated 5 days ago • 496

upvoted a collection 3 months ago

MMLU Pro benchmark for GGUFs (1 shot)

"Not all quantized model perform good", serving framework ollama uses NVIDIA gpu, llama.cpp uses CPU with AVX & AMX • 13 items • Updated Aug 15 • 10

upvoted a collection 4 months ago

gpt-oss

OpenAI's gpt-oss-20b and gpt-oss-120b is here! The powerful open models are available in GGUF, original & 4-bit formats. • 18 items • Updated 4 days ago • 36

upvoted a collection 7 months ago

Qwen3

84 items • Updated Aug 6 • 1.47k

upvoted a collection 8 months ago

Llama 4

Meta's new Llama 4 multimodal models, Scout & Maverick. Includes Dynamic GGUFs, 16-bit & Dynamic 4-bit uploads. Run & fine-tune them with Unsloth! • 15 items • Updated 4 days ago • 53

upvoted a collection 9 months ago

Gemma 3

All versions of Google's new multimodal models including QAT in 1B, 4B, 12B, and 27B sizes. In GGUF, dynamic 4-bit and 16-bit formats. • 55 items • Updated 4 days ago • 96

upvoted 2 articles 10 months ago

Article

How to deploy and fine-tune DeepSeek models on AWS

+1

Jan 30

•

55

Article

Make LLM Fine-tuning 2x faster with Unsloth and 🤗 TRL

Jan 10, 2024

•

74

upvoted 3 collections 11 months ago

DeepSeek R1 (All Versions)

DeepSeek-R1-0528 is here! The most powerful reasoning open LLM, available in GGUF, original & 4-bit formats. Includes Llama & Qwen distilled models. • 37 items • Updated 4 days ago • 261

Phi-4 (All Versions)

Microsoft's Phi-4 models including Reasoning + Reasoning Plus & mini. Includes Dynamic 2.0 GGUF, 4-bit & 16-bit versions. Includes Unsloth's bug fixes • 20 items • Updated 4 days ago • 76

Deepseek V3 (All Versions)

Deepseek-V3-0324 and V3 - available in original, and Dynamic GGUF formats, with support for 2-8-bit quantized versions. • 7 items • Updated 4 days ago • 39

upvoted 2 collections 12 months ago

Eule

A series of English/Russian reasoning models. • 2 items • Updated Dec 12, 2024 • 2

Llama 3.3 (All Versions)

Meta's new Llama 3.3 (70B) model in all formats. Includes GGUF, 4-bit bnb and original versions. • 3 items • Updated 4 days ago • 37

upvoted a collection about 1 year ago

Unsloth 4-bit Dynamic Quants

Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit • 28 items • Updated 4 days ago • 91

upvoted an article about 1 year ago

Article

Unleashing the Power of Unsloth and QLora:Redefining Language Model Fine-Tuning

Jan 19, 2024

•

18

upvoted 3 collections about 1 year ago

Vision/multimodal Models

Collection of the most popular vision models including Llama 3.2, LlaVa, Qwen2 VL, Pixtral, PaliGemma and more! • 25 items • Updated 4 days ago • 20

Llama 3.2 Vision

Meta's Llama 3.2 vision models 11B and 90B. Include 4-bit bnb and original versions. • 8 items • Updated 4 days ago • 7

Qwen 2.5 Coder

Complete collection of Code-specific model series for Qwen2.5 in bnb 4bit, 16bit and GGUF formats. • 35 items • Updated 4 days ago • 35

upvoted an article about 1 year ago

Article

Fixing Gradient Accumulation

+4

Oct 16, 2024

•

63