Spaces:

syedfaisalabrar
/

License_Classification

Sleeping

syedfaisalabrar commited on Feb 26

Commit

d0e1029

verified ·

1 Parent(s): fd40911

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -20,7 +20,7 @@ path = "OpenGVLab/InternVL2_5-4B"
 model = AutoModel.from_pretrained(
     path,
     cache_dir=cache_folder,
-    torch_dtype=torch.bfloat16,,
     load_in_8bit=True,
     low_cpu_mem_usage=True,
     use_flash_attn=True,

 model = AutoModel.from_pretrained(
     path,
     cache_dir=cache_folder,
+    torch_dtype=torch.bfloat16,
     load_in_8bit=True,
     low_cpu_mem_usage=True,
     use_flash_attn=True,