Validation ground truth will not be released

Hi,

I couldn’t find the ground truth for the validation set. Is that available or not?

Best

Hi Jeffery,

you need to upload your predictions of validation dataset to the grading webpage.
Then the score of your result will appear.
1 Like

Hi @mylotarg1989,

Indeed, you will privately receive a score for the Validation phase, but the ground truth is not made public during the Challenge, to ensure the overall integrity of all submissions.

Of course, you may make unlimited submissions to the Validation phase, and our scoring system will provide scores for each one. However, for more robust iterative self-evaluation of your algorithm, we suggest creating your own splits from the Training data.

Hi,

Why in Task 3, The Validation does not contain ground-truth labels?

Thank you

Hi @saleh.meizu,

See our answer in this thread:

You will privately receive a score for the Validation phase, but the ground truth is not made public during the Challenge, to ensure the overall integrity of all submissions.

Of course, you may make unlimited submissions to the Validation phase, and our scoring system will provide scores for each one. However, for more robust iterative self-evaluation of your algorithm, we suggest creating your own splits from the Training data.

OK, it is available now,
How come the Task 3: Validation Input data-set does not contain ground truth labels?
It would be impossible to generate a confusion matrix without the GT labels.

Thanks,

2 Likes

Hi @shlomo,

Just to fully follow up on your question, see the response in this thread where I’ve moved your post.