Update README.md

README.md

@@ -6,10 +6,22 @@ tags:
 model-index:
 - name: TinyLlama-1.1B-DPO-Function-Calling-3T
   results: []
+datasets:
+- argilla/distilabel-intel-orca-dpo-pairs
+language:
+- en
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
+## TinyLlama-1.1B-DPO-Function-Calling-3T
+
+
+This model is a DPO fine tune of [gardner/TinyLlama-1.1B-SlimOrca-Function-Calling-3T](https://huggingface.co/datasets/gardner/TinyLlama-1.1B-SlimOrca-Function-Calling-3T) which itself was trained on:
+
+1. [Open-Orca/SlimOrca-Dedup](https://huggingface.co/datasets/Open-Orca/SlimOrca-Dedup)
+1. [gardner/glaive-function-calling-v2-sharegpt](https://huggingface.co/datasets/gardner/glaive-function-calling-v2-sharegpt)
+
+The model scores unusually high on GSM8K which indicates the glaive function calling dataset may introduce data contamination.
+
 
 [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
 <details><summary>See axolotl config</summary>
@@ -113,20 +125,6 @@ dataloader_pin_memory: true
 
 This model is a fine-tuned version of [gardner/TinyLlama-1.1B-SlimOrca-Function-Calling-3T](https://huggingface.co/gardner/TinyLlama-1.1B-SlimOrca-Function-Calling-3T) on the None dataset.
 
-## Model description
-
-More information needed
-
-## Intended uses & limitations
-
-More information needed
-
-## Training and evaluation data
-
-More information needed
-
-## Training procedure
-
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
@@ -148,4 +146,4 @@ The following hyperparameters were used during training:
 - Transformers 4.37.0
 - Pytorch 2.1.2+cu121
 - Datasets 2.16.1
-- Tokenizers 0.15.0
+- Tokenizers 0.15.0