######### Changelog ######### Version 3.2 (2022-01-12) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add option to override existing "uri" - feat: add support for missing "uri" Version 3.1 (2021-09-27) ~~~~~~~~~~~~~~~~~~~~~~~~ - BREAKING: remove (buggy) support for parallel processing - fix: fix documentation deployment Version 3.0.1 (2020-07-02) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - setup: switch to pyannote.database 4.0+ Version 3.0 (2020-06-15) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add DetectionCostFunction detection metric (@nryant) - BREAKING: rename pyannote-metrics.py CLI to pyannote-metrics Version 2.3 (2020-02-26) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add DetectionPrecisionRecallFMeasure compound metric (@MarvinLvn) - fix: fix corner "in f-measure" case when both precision and recall are zero (@MarvinLvn) - fix: fix a typo in documentation (@wq2012) Version 2.2 (2019-12-13) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add support for evaluation of overlapped speech detection - feat: setup continuous integration - setup: switch to pyannote.core 3.2 Version 2.1 (2019-06-24) ~~~~~~~~~~~~~~~~~~~~~~~~ - chore: rewrite mapping and matching routines - fix: remove buggy xarray dependency - setup: switch to pyannote.core 3.0 Version 2.0.2 (2019-04-15) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - fix: avoid division by zero Version 2.0.1 (2019-03-20) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - BREAKING: drop support for all file formats but RTTM - BREAKING: drop Python 2.7 support - setup: switch to pyannote.database 2.0 - setup: switch to pyannote.core 2.1 Version 1.8.1 (2018-11-19) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - setup: switch to pyannote.core 2.0 Version 1.8 (2018-09-03) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add compound segmentation metric SegmentationPurityCoverageFMeasure (@diego-fustes) - fix: fix typo in IdentificationErrorAnalysis (@benjisympa) Version 1.7.1 (2018-09-03) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - fix: fix broken images in documentation Version 1.7 (2018-03-17) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add option to filter out target trials in "spotting" mode - chore: default to "parallel=False" Version 1.6.1 (2018-02-05) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - fix: fix Diarization{Purity | Coverage} with empty references - improve: improve support for speaker spotting experiments - chore: (temporarily?) remove parallel processing in pyannote.metrics.py - setup: drop support for Python 2 Version 1.5 (2017-10-20) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add fixed vs. variable latency switch for LLSS Version 1.4.3 (2017-10-17) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - fix: add more safety checks to pyannote-metrics.py "spotting" mode - setup: switch to pyannote.core 1.2, pyannote.database 1.1, pyannote.parser 0.7 Version 1.4.2 (2017-10-13) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - improve: set latency of missed detections to maximum possible value - improve: improve instructions in pyannote-metrics.py --help Version 1.4.1 (2017-10-02) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add LowLatencySpeakerSpotting metric - feat: add "spotting" mode to pyannote-metrics.py - setup: switch to pyannote.database 1.0 Version 1.3 (2017-09-19) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add "skip_overlap" option to not evaluate overlapping speech regions - improve: bring performance improvement to diarization metrics - fix: fix a bug where collar was applied twice in DiarizationErrorRate - fix: add collar support to purity/coverage/homogeneity/completeness - fix: fix a bug happening in 'uemify' when both reference and hypothesis are empty - fix: fix a "division by zero" error in homogeneity/completeness - setup: switch to pyannote.core 1.1 (major performance improvements) Version 1.2 (2017-07-21) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add method DiarizationPurityCoverageFMeasure.compute_metrics to get purity, coverage, and their F-measure (all at once) Version 1.1 (2017-07-20) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add new metric 'DiarizationPurityCoverageFMeasure' - doc: update installation instructions - setup: switch to pyannote.core 1.0.4 Version 1.0 (2017-07-04) ~~~~~~~~~~~~~~~~~~~~~~~~ - setup: switch to pyannote.core 1.0 - feat: add score calibration for binary classification tasks - doc: update citation Version 0.14.4 (2017-03-27) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - doc: update notebook to latest version Version 0.14.3 (2017-03-27) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - doc: add Sphinx documentation Version 0.14.2 (2017-03-21) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - feat: better README and technical report Version 0.14.1 (2017-03-16) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - chore: rename SegmentationError to SegmentationErrorAnalysis - fix: fix DetectionErrorRate support for kwargs Version 0.14 (2017-02-06) ~~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add "parallel" option to not use multiprocessing - feat: add "accuracy" in "detection" report - setup: switch to pyannote.core 0.13 - setup: switch to pyannote.parser 0.6.5 Version 0.13.2 (2017-01-30) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add pyannote-metrics.py evaluation script - fix: fix BaseMetric.report() for metric without a 'total' component - fix: fix (Greedy)DiarizationErrorRate uem handling - fix: fix (Greedy)DiarizationErrorRate parallel processing - setup: switch to pyannote.core 0.12 - setup: update munkres & matplotlib dependencies Version 0.12.1 (2017-01-27) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - feat: support for multiprocessing - feat: add report() method - feat: travis continuous integration (finally!) - improve: speed up detection metrics - feat: add unit tests for detection metrics - fix: fix python 3 support - setup: remove dependency to pyannote.algorithms - setup: switch to pyannote.core 0.11 Version 0.11 (2016-12-13) ~~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add pyannote.metrics.binary_classification module Version 0.10.3 (2016-11-28) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - fix: fix (greedy) diarization error rate - feat: add support for 'collar' to (greedy) diarization error rate Version 0.10.2 (2016-11-10) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - fix: fix default "xlim" in "plot_distributions" - setup: switch to pyannote.core 0.8 and pyannote.algorithms 0.6.6 Version 0.10.1 (2016-11-05) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add "uem" support to diarization metrics Version 0.9 (2016-09-23) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: add plotting functions for binary classification tasks Version 0.8 (2016-08-25) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: detection accuracy - refactor: detection metrics - setup: update to pyannote.core 0.7.2 Version 0.7.1 (2016-06-24) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - setup: update to pyannote.core 0.6.6 Version 0.7 (2016-04-04) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat: greedy diarization error rate Version 0.6.0 (2016-03-29) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - feat: Python 3 support - feat: unit tests - wip: travis Version 0.5.1 (2016-02-19) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - refactor: diarization metrics Version 0.4.1 (2014-11-20) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - fix: identification error analysis matrix confusion Version 0.4 (2014-10-31) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat(error): identification regression analysis - feat: new pyannote_eval.py CLI Version 0.3 (2014-10-01) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat(error): segmentation error analysis Version 0.2 (2014-08-05) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat(detection): add precision and recall - fix(identification): fix precision and recall Version 0.1 (2014-06-27) ~~~~~~~~~~~~~~~~~~~~~~~~ - feat(segmentation): add precision and recall - feat(identification): add support for NIST collar - feat(error): add module for detailed error analysis Version 0.0.1 (2014-06-04) ~~~~~~~~~~~~~~~~~~~~~~~~~~ - first public version