Original model: Kinggaroo-12b-v2 by kainatq
Available ExLlamaV3 0.0.16 quants
| Type | Size | CLI |
|---|---|---|
| H8-4.0BPW | 7.49 GB | Copy-paste the line / Download the batch file |
| H8-6.0BPW | 10.22 GB | Copy-paste the line / Download the batch file |
| H8-8.0BPW | 12.94 GB | Copy-paste the line / Download the batch file |
Requirements: A python installation with huggingface-hub module to use CLI.
Licensing: The license for the provided quantized models is derived from the original model (see the source above)
Model tree for DeathGodlike/Kinggaroo-12b-v2_EXL3
Base model
kainatq/Kinggaroo-12b-v2