Update README.md
Browse files
README.md
CHANGED
|
@@ -361,7 +361,7 @@ Data collection methods vary across individual datasets. For example, the above
|
|
| 361 |
|
| 362 |
### Training Datasets (Real conversations)
|
| 363 |
- Fisher English (LDC)
|
| 364 |
-
- AMI Meeting Corpus
|
| 365 |
- VoxConverse-v0.3
|
| 366 |
- ICSI
|
| 367 |
- AISHELL-4
|
|
@@ -370,6 +370,7 @@ Data collection methods vary across individual datasets. For example, the above
|
|
| 370 |
- DiPCo
|
| 371 |
- AliMeeting
|
| 372 |
|
|
|
|
| 373 |
### Training Datasets (Used to simulate audio mixtures)
|
| 374 |
- 2004-2010 NIST Speaker Recognition Evaluation (LDC)
|
| 375 |
- Librispeech
|
|
@@ -390,7 +391,10 @@ Data collection methods vary across individual datasets. For example, the above
|
|
| 390 |
| **CALLHOME-part2 5spk** | 5 | 5 |
|
| 391 |
| **CALLHOME-part2 6spk** | 6 | 3 |
|
| 392 |
| **CALLHOME-part2 full** | 2-6 | 250 |
|
| 393 |
-
| **
|
|
|
|
|
|
|
|
|
|
| 394 |
|
| 395 |
|
| 396 |
### Diarization Error Rate (DER)
|
|
@@ -403,10 +407,10 @@ Data collection methods vary across individual datasets. For example, the above
|
|
| 403 |
|
| 404 |
# Dataset Evaluation Results
|
| 405 |
|
| 406 |
-
|
|
| 407 |
-
|
| 408 |
-
|
|
| 409 |
-
|
|
| 410 |
|
| 411 |
|
| 412 |
|
|
|
|
| 361 |
|
| 362 |
### Training Datasets (Real conversations)
|
| 363 |
- Fisher English (LDC)
|
| 364 |
+
- AMI Meeting Corpus (IHM, SDM)
|
| 365 |
- VoxConverse-v0.3
|
| 366 |
- ICSI
|
| 367 |
- AISHELL-4
|
|
|
|
| 370 |
- DiPCo
|
| 371 |
- AliMeeting
|
| 372 |
|
| 373 |
+
|
| 374 |
### Training Datasets (Used to simulate audio mixtures)
|
| 375 |
- 2004-2010 NIST Speaker Recognition Evaluation (LDC)
|
| 376 |
- Librispeech
|
|
|
|
| 391 |
| **CALLHOME-part2 5spk** | 5 | 5 |
|
| 392 |
| **CALLHOME-part2 6spk** | 6 | 3 |
|
| 393 |
| **CALLHOME-part2 full** | 2-6 | 250 |
|
| 394 |
+
| **Alimeeting Eval** | 4 | - |
|
| 395 |
+
| **AMI Eval** | 4 | - |
|
| 396 |
+
| **NOTSOFAR1 Eval** | 4 | - |
|
| 397 |
+
| **CHAES CH109 (2spk set)** | 2 | 109 |
|
| 398 |
|
| 399 |
|
| 400 |
### Diarization Error Rate (DER)
|
|
|
|
| 407 |
|
| 408 |
# Dataset Evaluation Results
|
| 409 |
|
| 410 |
+
| **Latency** | *PP* | **DIHARD III Eval <=4spk** | **DIHARD III Eval >=5spk** | **DIHARD III Eval full** | **CALLHOME-part2 2spk** | **CALLHOME-part2 3spk** | **CALLHOME-part2 4spk** | **CALLHOME-part2 5spk** | **CALLHOME-part2 6spk** | **CALLHOME-part2 full** | **CH109** | **AliMeeting Test near** | **AliMeeting Test far** | **AMI Test IHM** | **AMI Test SDM** | **NOTSOFAR1 Eval SC <=4spk** | **NOTSOFAR1 Eval SC >=5spk** |
|
| 411 |
+
|-------------|------|----------------------------|----------------------------|--------------------------|-------------------------|-------------------------|-------------------------|-------------------------|-------------------------|-------------------------|-----------|--------------------------|-------------------------|------------------|------------------|------------------------------|------------------------------|
|
| 412 |
+
| 30.4s | no | 14.84 | 38.90 | 19.49 | 5.65 | 10.03 | 12.33 | 22.35 | 22.26 | 10.10 | 5.04 | 11.73 | 13.55 | 15.90 | 17.80 | 15.95 | 34.81 |
|
| 413 |
+
| 1.04s | no | 15.09 | 41.42 | 20.21 | 6.65 | 11.25 | 13.35 | 22.12 | 24.51 | 11.19 | 5.09 | 12.60 | 15.60 | 16.67 | 20.57 | 17.26 | 36.76 |
|
| 414 |
|
| 415 |
|
| 416 |
|