davidlms commited on
Commit
40043b3
·
verified ·
1 Parent(s): d556fd7

Extract evaluation results from README

Browse files

This commit adds structured evaluation results to the model card. The results are formatted using the model-index specification and will be displayed in the model card's evaluation widget.

Files changed (1) hide show
  1. README.md +26 -3
README.md CHANGED
@@ -1,12 +1,35 @@
1
  ---
2
  library_name: vllm
3
  inference: false
4
- extra_gated_description: >-
5
- If you want to learn more about how we process your personal data, please read
6
- our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
7
  tags:
8
  - mistral-common
9
  license: other
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ---
11
 
12
  # Devstral 2 123B Instruct 2512
 
1
  ---
2
  library_name: vllm
3
  inference: false
4
+ extra_gated_description: If you want to learn more about how we process your personal
5
+ data, please read our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
 
6
  tags:
7
  - mistral-common
8
  license: other
9
+ model-index:
10
+ - name: Devstral-2-123B-Instruct-2512
11
+ results:
12
+ - task:
13
+ type: text-generation
14
+ dataset:
15
+ name: Benchmarks
16
+ type: benchmark
17
+ metrics:
18
+ - name: Size (B Parameters)
19
+ type: size_(b_parameters)
20
+ value: 123.0
21
+ - name: SWE Bench Verified
22
+ type: swe_bench_verified
23
+ value: 72.2
24
+ - name: SWE Bench Multilingual
25
+ type: swe_bench_multilingual
26
+ value: 61.3
27
+ - name: Terminal Bench 2
28
+ type: terminal_bench_2
29
+ value: 32.6
30
+ source:
31
+ name: Model README
32
+ url: https://huggingface.co/mistralai/Devstral-2-123B-Instruct-2512
33
  ---
34
 
35
  # Devstral 2 123B Instruct 2512