taejinp commited on
Commit
9fb6bdf
·
1 Parent(s): b8a58af

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -6
README.md CHANGED
@@ -361,7 +361,7 @@ Data collection methods vary across individual datasets. For example, the above
361
 
362
  ### Training Datasets (Real conversations)
363
  - Fisher English (LDC)
364
- - AMI Meeting Corpus
365
  - VoxConverse-v0.3
366
  - ICSI
367
  - AISHELL-4
@@ -370,6 +370,7 @@ Data collection methods vary across individual datasets. For example, the above
370
  - DiPCo
371
  - AliMeeting
372
 
 
373
  ### Training Datasets (Used to simulate audio mixtures)
374
  - 2004-2010 NIST Speaker Recognition Evaluation (LDC)
375
  - Librispeech
@@ -390,7 +391,10 @@ Data collection methods vary across individual datasets. For example, the above
390
  | **CALLHOME-part2 5spk** | 5 | 5 |
391
  | **CALLHOME-part2 6spk** | 6 | 3 |
392
  | **CALLHOME-part2 full** | 2-6 | 250 |
393
- | **CH109** | 2 | 109 |
 
 
 
394
 
395
 
396
  ### Diarization Error Rate (DER)
@@ -403,10 +407,10 @@ Data collection methods vary across individual datasets. For example, the above
403
 
404
  # Dataset Evaluation Results
405
 
406
- | Model | CHAES | AMI-Eval | AMI-Eval | DipCo | Mixer6 |
407
- |---------------------------------------|:------:|:--------:|:--------:|:-----:|:------:|
408
- | **Configurations** | CH-109 | IHM | SDM | CH1 | CH4 |
409
- | **diar_sortformer_streaming-v2.nemo** | 15.81% | 21.26% | 0.00% | 0.00% | 0.00% |
410
 
411
 
412
 
 
361
 
362
  ### Training Datasets (Real conversations)
363
  - Fisher English (LDC)
364
+ - AMI Meeting Corpus (IHM, SDM)
365
  - VoxConverse-v0.3
366
  - ICSI
367
  - AISHELL-4
 
370
  - DiPCo
371
  - AliMeeting
372
 
373
+
374
  ### Training Datasets (Used to simulate audio mixtures)
375
  - 2004-2010 NIST Speaker Recognition Evaluation (LDC)
376
  - Librispeech
 
391
  | **CALLHOME-part2 5spk** | 5 | 5 |
392
  | **CALLHOME-part2 6spk** | 6 | 3 |
393
  | **CALLHOME-part2 full** | 2-6 | 250 |
394
+ | **Alimeeting Eval** | 4 | - |
395
+ | **AMI Eval** | 4 | - |
396
+ | **NOTSOFAR1 Eval** | 4 | - |
397
+ | **CHAES CH109 (2spk set)** | 2 | 109 |
398
 
399
 
400
  ### Diarization Error Rate (DER)
 
407
 
408
  # Dataset Evaluation Results
409
 
410
+ | **Latency** | *PP* | **DIHARD III Eval <=4spk** | **DIHARD III Eval >=5spk** | **DIHARD III Eval full** | **CALLHOME-part2 2spk** | **CALLHOME-part2 3spk** | **CALLHOME-part2 4spk** | **CALLHOME-part2 5spk** | **CALLHOME-part2 6spk** | **CALLHOME-part2 full** | **CH109** | **AliMeeting Test near** | **AliMeeting Test far** | **AMI Test IHM** | **AMI Test SDM** | **NOTSOFAR1 Eval SC <=4spk** | **NOTSOFAR1 Eval SC >=5spk** |
411
+ |-------------|------|----------------------------|----------------------------|--------------------------|-------------------------|-------------------------|-------------------------|-------------------------|-------------------------|-------------------------|-----------|--------------------------|-------------------------|------------------|------------------|------------------------------|------------------------------|
412
+ | 30.4s | no | 14.84 | 38.90 | 19.49 | 5.65 | 10.03 | 12.33 | 22.35 | 22.26 | 10.10 | 5.04 | 11.73 | 13.55 | 15.90 | 17.80 | 15.95 | 34.81 |
413
+ | 1.04s | no | 15.09 | 41.42 | 20.21 | 6.65 | 11.25 | 13.35 | 22.12 | 24.51 | 11.19 | 5.09 | 12.60 | 15.60 | 16.67 | 20.57 | 17.26 | 36.76 |
414
 
415
 
416