From 89980bcf62506064d46a62d39b5a993da674baf8 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Herv=C3=A9=20BREDIN?= Date: Thu, 12 Jun 2025 18:31:08 +0200 Subject: [PATCH] doc: update pyannoteAI benchmark --- README.md | 26 +++++++++++++------------- 1 file changed, 13 insertions(+), 13 deletions(-) diff --git a/README.md b/README.md index 85be48aa..6ace8319 100644 --- a/README.md +++ b/README.md @@ -83,19 +83,19 @@ Out of the box, `pyannote.audio` speaker diarization [pipeline v3.1](https://hf. | Benchmark (2025-03) | [v2.1](https://hf.co/pyannote/speaker-diarization-2.1) | [v3.1](https://hf.co/pyannote/speaker-diarization-3.1) | | | --------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------ | ------------------------------------------------------ | ------------------------------------------------ | -| [AISHELL-4](https://arxiv.org/abs/2104.03603) | 14.1 | 12.2 | 12.1 | -| [AliMeeting](https://www.openslr.org/119/) (channel 1) | 27.4 | 24.5 | 19.8 | -| [AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (IHM) | 18.9 | 18.8 | 15.8 | -| [AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (SDM) | 27.1 | 22.7 | 18.3 | -| [AVA-AVD](https://arxiv.org/abs/2111.14448) | 66.3 | 49.7 | 45.3 | -| [CALLHOME](https://catalog.ldc.upenn.edu/LDC2001S97) ([part 2](https://github.com/BUTSpeechFIT/CALLHOME_sublists/issues/1)) | 31.6 | 28.4 | 20.1 | -| [DIHARD 3](https://catalog.ldc.upenn.edu/LDC2022S14) ([full](https://arxiv.org/abs/2012.01477)) | 26.9 | 21.4 | 17.2 | -| [Earnings21](https://github.com/revdotcom/speech-datasets) | 17.0 | 9.4 | 9.0 | -| [Ego4D](https://arxiv.org/abs/2110.07058) (dev.) | 61.5 | 51.2 | 45.8 | -| [MSDWild](https://github.com/X-LANCE/MSDWILD) | 32.8 | 25.4 | 19.7 | -| [RAMC](https://www.openslr.org/123/) | 22.5 | 22.2 | 11.1 | -| [REPERE](https://www.islrn.org/resources/360-758-359-485-0/) (phase2) | 8.2 | 7.9 | 7.6 | -| [VoxConverse](https://github.com/joonson/voxconverse) (v0.3) | 11.2 | 11.2 | 9.9 | +| [AISHELL-4](https://arxiv.org/abs/2104.03603) | 14.1 | 12.2 | 11.9 | +| [AliMeeting](https://www.openslr.org/119/) (channel 1) | 27.4 | 24.5 | 16.6 | +| [AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (IHM) | 18.9 | 18.8 | 13.2 | +| [AMI](https://groups.inf.ed.ac.uk/ami/corpus/) (SDM) | 27.1 | 22.7 | 15.8 | +| [AVA-AVD](https://arxiv.org/abs/2111.14448) | 66.3 | 49.7 | 39.9 | +| [CALLHOME](https://catalog.ldc.upenn.edu/LDC2001S97) ([part 2](https://github.com/BUTSpeechFIT/CALLHOME_sublists/issues/1)) | 31.6 | 28.4 | 17.8 | +| [DIHARD 3](https://catalog.ldc.upenn.edu/LDC2022S14) ([full](https://arxiv.org/abs/2012.01477)) | 26.9 | 21.4 | 15.7 | +| [Earnings21](https://github.com/revdotcom/speech-datasets) | 17.0 | 9.4 | 9.1 | +| [Ego4D](https://arxiv.org/abs/2110.07058) (dev.) | 61.5 | 51.2 | 42.8 | +| [MSDWild](https://github.com/X-LANCE/MSDWILD) | 32.8 | 25.4 | 17.8 | +| [RAMC](https://www.openslr.org/123/) | 22.5 | 22.2 | 10.6 | +| [REPERE](https://www.islrn.org/resources/360-758-359-485-0/) (phase2) | 8.2 | 7.9 | 7.3 | +| [VoxConverse](https://github.com/joonson/voxconverse) (v0.3) | 11.2 | 11.2 | 8.9 | [Diarization error rate](http://pyannote.github.io/pyannote-metrics/reference.html#diarization) (in %)