Apache-2.0 Open High Quality Math Corpus
AI & ML interests
None defined yet.
Rewriting Pre-Training Data Boosts LLM Performance in Math and Code
-
tokyotech-llm/swallow-code
Viewer • Updated • 129M • 14.4k • 58 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B • Updated • 15 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B • Updated • 17 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B • Updated • 6
-
tokyotech-llm/Llama-3-Swallow-8B-v0.1
Text Generation • 8B • Updated • 376 • • 11 -
tokyotech-llm/Llama-3-Swallow-70B-v0.1
Text Generation • 71B • Updated • 58 • • 6 -
tokyotech-llm/Llama-3-Swallow-8B-Instruct-v0.1
Text Generation • 8B • Updated • 21.6k • • 20 -
tokyotech-llm/Llama-3-Swallow-70B-Instruct-v0.1
Text Generation • 71B • Updated • 102 • • 7
Swallow instruction tuning models
-
tokyotech-llm/Swallow-7b-instruct-v0.1
Text Generation • 7B • Updated • 402 • 3 -
tokyotech-llm/Swallow-13b-instruct-v0.1
Text Generation • 13B • Updated • 227 • 1 -
tokyotech-llm/Swallow-70b-instruct-v0.1
Text Generation • 69B • Updated • 63 -
tokyotech-llm/Swallow-70b-NVE-instruct-hf
Text Generation • 69B • Updated • 49 • 2
Swallow MX(Mixtral) models
Apache-2.0 Open High Quality Code Corpus
Rewriting Pre-Training Data Boosts LLM Performance in Math and Code
-
tokyotech-llm/swallow-math
Viewer • Updated • 4.33M • 3.85k • 37 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 11 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 7 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 11
-
tokyotech-llm/Gemma-2-Llama-Swallow-27b-pt-v0.1
Text Generation • 27B • Updated • 689 • 1 -
tokyotech-llm/Gemma-2-Llama-Swallow-9b-pt-v0.1
Text Generation • 9B • Updated • 3.07k • 1 -
tokyotech-llm/Gemma-2-Llama-Swallow-2b-pt-v0.1
Text Generation • 3B • Updated • 746 -
tokyotech-llm/Gemma-2-Llama-Swallow-2b-it-v0.1
Text Generation • 3B • Updated • 1.22k • 3
-
tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.5
Text Generation • 8B • Updated • 17.1k • • 14 -
tokyotech-llm/Llama-3.1-Swallow-8B-v0.5
8B • Updated • 1.67k • 6 -
tokyotech-llm/Llama-3.1-Swallow-70B-Instruct-v0.3
Text Generation • 71B • Updated • 21.2k • 14 -
tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.3
Text Generation • 8B • Updated • 4.08k • • 22
Continual Pre-Training from Llama 2
Swallow MS(Mistral) models
Apache-2.0 Open High Quality Math Corpus
Apache-2.0 Open High Quality Code Corpus
Rewriting Pre-Training Data Boosts LLM Performance in Math and Code
-
tokyotech-llm/swallow-math
Viewer • Updated • 4.33M • 3.85k • 37 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 11 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 7 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 11
Rewriting Pre-Training Data Boosts LLM Performance in Math and Code
-
tokyotech-llm/swallow-code
Viewer • Updated • 129M • 14.4k • 58 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B • Updated • 15 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B • Updated • 17 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B • Updated • 6
-
tokyotech-llm/Gemma-2-Llama-Swallow-27b-pt-v0.1
Text Generation • 27B • Updated • 689 • 1 -
tokyotech-llm/Gemma-2-Llama-Swallow-9b-pt-v0.1
Text Generation • 9B • Updated • 3.07k • 1 -
tokyotech-llm/Gemma-2-Llama-Swallow-2b-pt-v0.1
Text Generation • 3B • Updated • 746 -
tokyotech-llm/Gemma-2-Llama-Swallow-2b-it-v0.1
Text Generation • 3B • Updated • 1.22k • 3
-
tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.5
Text Generation • 8B • Updated • 17.1k • • 14 -
tokyotech-llm/Llama-3.1-Swallow-8B-v0.5
8B • Updated • 1.67k • 6 -
tokyotech-llm/Llama-3.1-Swallow-70B-Instruct-v0.3
Text Generation • 71B • Updated • 21.2k • 14 -
tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.3
Text Generation • 8B • Updated • 4.08k • • 22
-
tokyotech-llm/Llama-3-Swallow-8B-v0.1
Text Generation • 8B • Updated • 376 • • 11 -
tokyotech-llm/Llama-3-Swallow-70B-v0.1
Text Generation • 71B • Updated • 58 • • 6 -
tokyotech-llm/Llama-3-Swallow-8B-Instruct-v0.1
Text Generation • 8B • Updated • 21.6k • • 20 -
tokyotech-llm/Llama-3-Swallow-70B-Instruct-v0.1
Text Generation • 71B • Updated • 102 • • 7
Continual Pre-Training from Llama 2
Swallow instruction tuning models
-
tokyotech-llm/Swallow-7b-instruct-v0.1
Text Generation • 7B • Updated • 402 • 3 -
tokyotech-llm/Swallow-13b-instruct-v0.1
Text Generation • 13B • Updated • 227 • 1 -
tokyotech-llm/Swallow-70b-instruct-v0.1
Text Generation • 69B • Updated • 63 -
tokyotech-llm/Swallow-70b-NVE-instruct-hf
Text Generation • 69B • Updated • 49 • 2
Swallow MS(Mistral) models
Swallow MX(Mixtral) models