ISIC Forum

Isic2018 task 1 submission

the ISIC 2018 live-leaderboard

Task 1: Test submission: submission_5bee430fc5eaea4f24b5ebee_1560778496575

After the June 13th, there was an error in submission and I made sure my submission file format was correct. I don’t know if everyone has encountered this problem?

covalic.error: Internal error: unknown ground truth phase number: 1.
DockerException: Non-zero exit code from docker container (1).
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/celery/app/trace.py”, line 375, in trace_task
R = retval = fun(args, **kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/task.py”, line 153, in call
results = super(Task, self).call(
_t_args, **_t_kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/celery/app/trace.py”, line 632, in protected_call
return self.run(*args, **kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/tasks.py”, line 19, in run
return core.run(*pargs, **kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/core/utils.py”, line 123, in wrapped
return fn(*args, **kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/core/init.py”, line 183, in run
task_outputs=task_outputs, **kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/plugins/docker/executor.py”, line 239, in run
stream_connectors=stream_connectors, **extra_run_kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/docker/tasks/init.py”, line 333, in _docker_run
_run_select_loop(task, container, read_streams, write_streams)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/docker/tasks/init.py”, line 184, in _run_select_loop
raise DockerException(‘Non-zero exit code from docker container (%d).’ % exit_code)

me too i have an error in submission with task 3 and I’m sure that my submission was correct

HTTP push failed (https://submission.challenge.isic-archive.com/api/v1/covalic_submission/5d062f32c5eaea43b32fe35e/score ). Response: {“message”: "Invalid JSON object for parameter score: [{u’threshold’: 2.0, u’tpr’: 0.0, u’fpr’: 0.0}, {u’threshold’: 1.0, u’tpr’: 0.10526315789473684, u’fpr’: 0.008208955223880597}, {u’threshold’: 0.9990000000000001, u’tpr’: 0.13450292397660818, u’fpr’: 0.008955223880597015}, {u’threshold’: 0.998, u’tpr’: …

HTTPError: 400 Client Error: Bad Request for url: https://submission.challenge.isic-archive.com/api/v1/covalic_submission/5d062f32c5eaea43b32fe35e/score
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/celery/app/trace.py”, line 375, in trace_task
R = retval = fun( args, **kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/task.py”, line 153, in call
results = super(Task, self). call (
_t_args, **_t_kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/celery/app/trace.py”, line 632, in protected_call
return self.run(*args, **kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/tasks.py”, line 19, in run
return core.run(*pargs, **kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/core/utils.py”, line 123, in wrapped
return fn(*args, **kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/core/ init .py”, line 203, in run
io.push(data, outputs[name], **dict({‘task_output’: task_output}, **kwargs))
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/core/io/ init .py”, line 150, in push
return _push_map[mode](data, spec, **kwargs)
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/girder_worker/core/io/http.py”, line 200, in push
request.raise_for_status()
File “/home/ubuntu/.venvs/girder/local/lib/python2.7/site-packages/requests/models.py”, line 940, in raise_for_status
raise HTTPError(http_error_msg, response=self)

Hi @kourne and @sami,

You may have already seen this in other threads, but just to follow up:

We’ve just resolved this issue. You should now be able to submit normally.

Apologies, we’ve been making some improvements to the scoring system which were released prematurely. Please let us know if you have any other issues.

Regards,
Brian