George B. Moody PhysioNet Challenge
Quick links for this year's Challenge:
- Registration form
- Example MATLAB and Python classifier and scoring code
- Submission instructions and form
- Leaderboard
- Public discussion forum
- Rules and deadlines
- Current and General FAQs
- About
PhysioNet/CinC Challenge 2021 Results
This page contains the final scores for the 2021 PhysioNet/CinC Challenge:
- Official entries: only Challenge metric scores (12-lead, 6-lead, 4-lead, 3-lead, 2-lead, and all-lead) and all scores (12-lead, 6-lead, 4-lead, 3-lead, and 2-lead)
- Unofficial entries: only Challenge metric scores (12-lead, 6-lead, 4-lead, 3-lead, 2-lead, and all-lead) and all scores (12-lead, 6-lead, 4-lead, 3-lead, and 2-lead)
- Team eligibility: here (determines whether entries are official or unofficial)
- Per-class metrics: for both official and unofficial entries (12-lead, 6-lead, 4-lead, 3-lead and 2-lead)
These tables contain scores for the 12-lead, 6-lead, 4-lead, 3-lead, and 2-lead versions of the hidden validation and test sets. The 2021 Challenge webpage and 2021 Challenge paper describes the lead combinations and the validation and test data sources. We also included an all-lead score in the tables, which is computed as the mean of the 12-lead, 3-lead, and 2-lead scores.
We used the Challenge scoring metric that we implemented in the evaluation code repository to rank the official entries on the test set. We sorted the unofficial entries alphabetically by team name.
In these tables, you can find the following information:
- The only Challenge metric scores of the official entries (12-lead, 6-lead, 4-lead, 3-lead, 2-lead, and all-lead) and only Challenge metric scores of the unofficial entries (12-lead, 6-lead, 4-lead, 3-lead, 2-lead, and all-lead) CSV files provide the Challenge scoring metric on the hidden datasets as well as the the run time for training the models and running the trained models. You can find the results of every lead combination of the 12-lead, 6-lead, 4-lead, 3-lead, 2-lead and all-lead (mean of the scores on the 12-lead, 3-lead, and 2-lead scores) scores in separate CSV files.
- The all scores of the official entries (12-lead, 6-lead, 4-lead, 3-lead, and 2-lead) and all scores of the unofficial entries (12-lead, 6-lead, 4-lead, 3-lead, and 2-lead) CSV files provide more evaluation metrics: the area under the receiver operating characteristic curve (AUROC), area under the precision recall curve (AUPRC), F-measure, accuracy, and the Challenge scoring metric scores. The accuracy metric is the fraction of correctly diagnosed recordings, i.e., all classes for the recording are correct. There are separate CSV files for the 12-lead, 6-lead, 4-lead, 3-lead, and 2-lead scores.
- The team eligibility table contains information about all of the 2021 Challenge entries (official and unofficial entries), including satisfiaction of the rules for rankings and prize eligibility.
- The per-class metrics (12-lead, 6-lead, 4-lead, 3-lead, and 2-lead) CSV files provide evaluation metrics (AUROC, AUPRC and F-measure) per-class on the hidden test dataset for all (official and unofficial) entries, sorted alphabetically. Please note that per-class metrics are undefined for classes without labels belonging to that class. There are separate CSV files for the 12-lead, 6-lead, 4-lead, 3-lead, and 2-lead metrics.
To refer to these tables in your publication, please cite the following papers:
Supported by the National Institute of Biomedical Imaging and Bioengineering (NIBIB) under NIH grant R01EB030362.