ISIC Forum

ISIC2019 Live Challenge Score Details Not Displayed

@brianhelba @tschandl I submitted ISIC2019 test predictions through ISIC Challenge Submission webpage, it displayed “succeeded” status without the score in the page. But, I received single score in email. Can we see the detailed results (eg. aucs, sensitivity, and so on) similar to the one displayed in ISIC2019 leaderboard?

3 Likes

It will be great having access to those scores.

I’m trying to submit but I’m struggling in this part:

image

The upload never concludes =/
Is anyone else with this problem?

Hello, I have also submitted predictions in the challenge “2019 Lesion Diagnosis” and received a single score by email (and reported in the https://challenge.isic-archive.com/). What does this score represent? Is the leaderboard (https://challenge2019.isic-archive.com/leaderboard.html) active?
Best, Alessio

It looks like a validation score computed for small subset of test set (8K images). I am guessing the subset might have only one or two class distribution. For all my submissions, I am getting very high score compared to the top score in ISIC 2019 challenge leaderboard.

Dear organizer,
Similar to @rhinos, I am getting a higher score compared to top scores displayed in ISIC 2019 challenge. I have a plan to submit a paper at the ISIC workshop CVPR2020. I am just wondering if you can provide baseline performance for this dataset. Also, how may we make sure that the feedback score is really outperforming last year’s competition (ISIC 2019).

Thanks a lot in advance.