Greetings Challenge participants,
We’re excited to announce the release of the ISIC Challenge 2018 submissions leaderboard.
We were thrilled to receive over 300 submissions this year! After the late breaking change to the manuscript submission process, we’ve now reviewed all submissions ourselves manually, and are proud to host the results for the public to see too.
We may make some very minor additions to the leaderboard over the next few days, so a few extra pending submissions may show up. However, we’ve structured the ordering so that no rankings will decrease, and some will increase if pending submissions are eliminated entirely. We should have a definitive leaderboard (and email announcement to the larger ISIC Challenge community) on Monday, August 6, but we wanted to share the results with all participants now, as soon as we possibly could!
Finally, we’ve promised a whole bunch of secondary (non-ranking) metrics, and are working to compute and deliver those soon. We expect to see the majority of additional metrics come online next week, along with improved tools to navigate this data. Our hope is that this trove of hundreds of teams, with most submitting multiple approaches, all associated with a detailed manuscript (our standard was sufficiency to make the algorithm reproducible), and objective multi-metric scoring on a large standard dataset will provide an important and largest-ever snapshot of the state-of-the-art in skin image analysis.
Thank you all again for your participation, and we hope to see many of you at our Workshop at MICCAI 2018.