Task 1, validation, Jaccard Index


For Task 1, I submitted my validation result and got the average score. The problem is that when I check the values of Jaccard Index for each image separately, sometimes it’s exactly 0.00e+0 but visually the segmentation of lesion seems to be correct. Is it normal?

Thank you,

I got the same Jaccard Index on below validation images;

What is the problem?

As far as I see the lesion-wise numbers on the evaluation platform already reflect the thresholded Jaccard metric used in this years challenge, i.e. if Jaccard for a single lesion <0.65 it displays and counts as 0.

Thanks Philipp for your info.