RedHatAI
/

granite-3.1-8b-base-quantized.w8a8

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

nm-research commited on Jan 20, 2025

Commit

d9cec86

·

verified ·

1 Parent(s): 33bba0f

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -148,8 +148,8 @@ oneshot(
 )
 # Save to disk compressed.
-model.save_pretrained(SAVE_DIR, save_compressed=True)
-tokenizer.save_pretrained(SAVE_DIR)
 ```
 ## Evaluation

 )
 # Save to disk compressed.
+model.save_pretrained(quant_path, save_compressed=True)
+tokenizer.save_pretrained(quant_path)
 ```
 ## Evaluation