DeepSeek-R1-Distill Quantized - a neuralmagic-ent Collection

neuralmagic-ent 's Collections

Mistral Quantized

phi-4 quantized

DeepSeek-R1-Distill Quantized

Granite-3.1 Quantized

DeepSeek-R1-Distill Quantized

updated Feb 12

RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic

Text Generation • 8B • Updated Feb 27 • 288 • 4
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8

Text Generation • 71B • Updated Feb 27 • 652 • 2
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16

Text Generation • 2B • Updated Feb 27 • 358
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8

Text Generation • 8B • Updated Feb 27 • 170k • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic

Text Generation • 2B • Updated Feb 27 • 35
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic

Text Generation • 15B • Updated Feb 27 • 1.07k • 3
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16

Text Generation • 3B • Updated Feb 27 • 384 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8

Text Generation • 15B • Updated Feb 27 • 2.52k • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic

Text Generation • 33B • Updated Feb 27 • 1.55k • 9
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16

Text Generation • 6B • Updated Feb 27 • 600 • 5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • 71B • Updated Feb 27 • 2.22k • 10
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic

Text Generation • 8B • Updated Feb 27 • 1.29k • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16

Text Generation • 2B • Updated Feb 27 • 378 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8

Text Generation • 2B • Updated Feb 27 • 3.03k • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8

Text Generation • 8B • Updated Feb 27 • 3.63k • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • 33B • Updated Feb 27 • 6.65k • 13
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Text Generation • 11B • Updated Feb 27 • 524 • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16

Text Generation • 0.6B • Updated Feb 27 • 13 • 1