unsloth
/

Llama-3.1-Nemotron-70B-Instruct-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

Problem loading with vllm

#8 opened about 1 year ago by

vram+ram

#7 opened about 1 year ago by

Code

#6 opened about 1 year ago by

code

#5 opened about 1 year ago by

colab t4

#4 opened about 1 year ago by

convert

#3 opened about 1 year ago by

to gguf

#2 opened about 1 year ago by

how to run

#1 opened about 1 year ago by