PhysioNet/Computing in Cardiology Challenge 2011: Top scores

The new PhysioNet website is available at: https://physionet.org. We welcome your feedback.

Following the final deadline for submission of entries on 5 August 2011, here are the final scores for the Challenge.

Event 1 (closed source, open data set B)

ParticipantScore
Xiaopeng Zhao0.932
Gari Clifford0.926
CT Ho0.920
Dieter Hayn0.916
Gabriel Garcia0.912
Nir Kalkstein0.912
Irena Jekova0.908
Sebastian Zaunseder0.904
Kai Noponen0.900
Benjamin Moody0.896

The top 10 (of 49) participants in event 1 are listed above. In this event, participants submitted classifications of each ECG in data set B; they were not required to submit their code for this event, and they were not required to use Java code as in events 2 and 3. Each score above is the accuracy of the participant's most successful entry. Accuracy is the fraction of reference classifications in set B that match those in the entry; the range is 0 to 1, where 1 would be perfect matching. Up to five entries were allowed for each participant.

Event 2 (open-source, open data set B)

ParticipantScore
Xiaopeng Zhao0.914
Benjamin Moody0.896
Lars Johannesen0.880
Philip Langley0.868
Dieter Hayn0.834
Václav Chudáček0.833
Unofficial entries
George Moody0.894
Ikaro Silva0.802

In this event, participants submitted Java code that the challenge organizers tested in a reference Android mobile phone using the same data and the same scoring method as in event 1. Only one entry was tested and scored for each participant; the same entry was also used for event 3.

Scores obtained by the challenge organizers using their own code are unofficial.

Event 3 (open source, closed data set C)

ParticipantScore
Dieter Hayn0.873
Václav Chudáček0.872
Xiaopeng Zhao 0.845
Philip Langley0.814
Benjamin Moody0.802
Lars Johannesen0.791
Unofficial entries
Ikaro Silva0.830
George Moody0.817

In the final event, the same code submitted by participants for event 2 was tested by the challenge organizers using data set C, which has not been released to participants, thus eliminating any possibility of "tuning" the code to specific ECGs in the data set. Scores for this event are calculated as a product of the accuracy as defined for events 1 and 2, and a function of mean run time in the reference Android phone.

As in event 2, scores obtained by the challenge organizers using their own code are unofficial.