Following the final deadline for submission of entries on 25 August 2012, each participant selected (or allowed the organizers to select) a previously submitted entry to be evaluated using Challenge test set C, which was used for validation only and not made available to participants. Scores obtained in the set C evaluations determined the final ranks shown below.
Event 1 (binary prediction of survival or in-hospital death)
Participant | Score |
---|---|
Alistair Johnson, Nic Dunkley, Louis Mayaud, Athanasios Tsanas, Andrew Kramer, Gari Clifford | 0.5353 |
Luca Citi, Riccardo Barbieri | 0.5345 |
Srinivasan Vairavan, Larry Eshelman, Syed Haider, Abigail Flower, Adam Seiver | 0.5009 |
Martin Macas, Michal Huptych, Jakub Kuzilek | 0.4928 |
Henian Xia, Brian Daley, Adam Petrie, Xiaopeng Zhao | 0.4923 |
Steven L Hamilton, James R Hamilton | 0.4872 |
Natalia M Arzeno, Joyce C Ho, Cheng H Lee | 0.4821 |
Chih-Chun Chia, Gyemin Lee, Zahi Karam, Alexander Van Esbroeck, Sean McMillan, Ilan Rubinfeld, Zeeshan Syed | 0.4564 |
Alexandros Pantelopoulos | 0.4544 |
Deep Bera, Mithun Manjnath Nayak | 0.4513 |
Sample and random predictors | |
SAPS-I (in m-code) | 0.3125 |
SAPS-I (in C) | 0.3097 |
86% randomly predicted to survive | 0.1386 |
The top 10 (of 28) participants in event 1 are listed above. The score is the smaller of sensitivity (the fraction of in-hospital deaths that are predicted) and positive predictivity (the fraction of predictions of in-hospital deaths that are correct). The range is 0 (worst) to 1 (ideal).
Event 2 (estimation of in-hospital mortality risk)
Participant | Score |
---|---|
Luca Citi, Riccardo Barbieri | 17.88 |
Tongbi Kang, Yilun Su, Lianying Ji | 20.58 |
Martin Macas, Michal Huptych, Jakub Kuzilek | 24.70 |
Chidube Ezeozue | 24.93 |
Alistair Johnson, Nic Dunkley, Louis Mayaud, Athanasios Tsanas, Andrew Kramer, Gari Clifford | 29.86 |
Mehmet Kayaalp | 36.38 |
Tom Pollard, Demetrio Martinez | 38.23 |
Deep Bera, Mithun Manjnath Nayak | 45.01 |
Antonio Bosnjak, Guillermo Montilla | 48.61 |
Natalia M Arzeno, Joyce C Ho, Cheng H Lee | 51.69 |
Sample and random predictors | |
SAPS-I (in m-code) | 68.58 |
SAPS-I (in C) | 35.21 |
86% randomly predicted to survive | 10137.7 |
The top 10 (of 23) participants in event 2 are listed above; 5 participants in event 1 did not enter event 2. The score is a range-normalized Hosmer-Lemeshow H statistic, which approaches an ideal value of 0 as risk is estimated more accurately and over a broader range; see Challenge scoring for details.