test error unet_segmentation_3d_ignite_clearml.ipynb

[2023-10-26T01:42:06.351Z] Running ./experiment_management/unet_segmentation_3d_ignite_clearml.ipynb
[2023-10-26T01:42:06.351Z] Checking PEP8 compliance...
[2023-10-26T01:42:07.278Z] Running notebook...
[2023-10-26T01:42:07.278Z] Before:
[2023-10-26T01:42:07.278Z]     "max_epochs = 10\n",
[2023-10-26T01:42:07.278Z] After:
[2023-10-26T01:42:07.278Z]     "max_epochs = 1\n",
[2023-10-26T01:42:15.360Z] MONAI version: 1.3.0+10.g85243f52
[2023-10-26T01:42:15.360Z] Numpy version: 1.22.2
[2023-10-26T01:42:15.360Z] Pytorch version: 2.1.0a0+29c30b1
[2023-10-26T01:42:15.360Z] MONAI flags: HAS_EXT = False, USE_COMPILED = False, USE_META_DICT = False
[2023-10-26T01:42:15.360Z] MONAI rev id: 85243f52085b0946870fc7808c484c8b639eaf1b
[2023-10-26T01:42:15.360Z] MONAI __file__: /home/jenkins/agent/workspace/Monai-notebooks/MONAI/monai/__init__.py
[2023-10-26T01:42:15.360Z] 
[2023-10-26T01:42:15.360Z] Optional dependencies:
[2023-10-26T01:42:15.360Z] Pytorch Ignite version: 0.4.11
[2023-10-26T01:42:15.360Z] ITK version: 5.3.0
[2023-10-26T01:42:15.360Z] Nibabel version: 5.1.0
[2023-10-26T01:42:15.360Z] scikit-image version: 0.22.0
[2023-10-26T01:42:15.360Z] scipy version: 1.11.1
[2023-10-26T01:42:15.360Z] Pillow version: 9.2.0
[2023-10-26T01:42:15.360Z] Tensorboard version: 2.9.0
[2023-10-26T01:42:15.360Z] gdown version: 4.7.1
[2023-10-26T01:42:15.360Z] TorchVision version: 0.16.0a0
[2023-10-26T01:42:15.360Z] tqdm version: 4.65.0
[2023-10-26T01:42:15.360Z] lmdb version: 1.4.1
[2023-10-26T01:42:15.360Z] psutil version: 5.9.4
[2023-10-26T01:42:15.360Z] pandas version: 1.5.2
[2023-10-26T01:42:15.360Z] einops version: 0.6.1
[2023-10-26T01:42:15.360Z] transformers version: 4.21.3
[2023-10-26T01:42:15.360Z] mlflow version: 2.7.1
[2023-10-26T01:42:15.360Z] pynrrd version: 1.0.0
[2023-10-26T01:42:15.360Z] clearml version: 1.13.2rc1
[2023-10-26T01:42:15.360Z] 
[2023-10-26T01:42:15.360Z] For details about installing the optional dependencies, please visit:
[2023-10-26T01:42:15.360Z]     https://docs.monai.io/en/latest/installation.html#installing-the-recommended-dependencies
[2023-10-26T01:42:15.360Z] 
[2023-10-26T01:42:17.879Z] papermill  --progress-bar -k python3
[2023-10-26T01:42:18.135Z] /usr/local/lib/python3.10/dist-packages/papermill/iorw.py:153: UserWarning: the file is not specified with any extension : -
[2023-10-26T01:42:18.135Z]   warnings.warn(
[2023-10-26T01:42:50.847Z] 
Executing:   0%|          | 0/35 [00:00<?, ?cell/s]
Executing:   3%|▎         | 1/35 [00:01<00:42,  1.25s/cell]
Executing:   9%|▊         | 3/35 [00:09<01:52,  3.50s/cell]
Executing:  14%|█▍        | 5/35 [00:17<01:53,  3.77s/cell]
Executing:  37%|███▋      | 13/35 [00:26<00:38,  1.74s/cell]
Executing:  43%|████▎     | 15/35 [00:28<00:31,  1.58s/cell]
Executing:  60%|██████    | 21/35 [00:30<00:13,  1.00cell/s]
Executing:  60%|██████    | 21/35 [00:32<00:21,  1.54s/cell]
[2023-10-26T01:42:50.847Z] /usr/local/lib/python3.10/dist-packages/papermill/iorw.py:153: UserWarning: the file is not specified with any extension : -
[2023-10-26T01:42:50.847Z]   warnings.warn(
[2023-10-26T01:42:50.847Z] Traceback (most recent call last):
[2023-10-26T01:42:50.847Z]   File "/usr/local/bin/papermill", line 8, in <module>
[2023-10-26T01:42:50.847Z]     sys.exit(papermill())
[2023-10-26T01:42:50.847Z]   File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 1157, in __call__
[2023-10-26T01:42:50.847Z]     return self.main(*args, **kwargs)
[2023-10-26T01:42:50.847Z]   File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 1078, in main
[2023-10-26T01:42:50.847Z]     rv = self.invoke(ctx)
[2023-10-26T01:42:50.847Z]   File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 1434, in invoke
[2023-10-26T01:42:50.847Z]     return ctx.invoke(self.callback, **ctx.params)
[2023-10-26T01:42:50.847Z]   File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 783, in invoke
[2023-10-26T01:42:50.847Z]     return __callback(*args, **kwargs)
[2023-10-26T01:42:50.847Z]   File "/usr/local/lib/python3.10/dist-packages/click/decorators.py", line 33, in new_func
[2023-10-26T01:42:50.847Z]     return f(get_current_context(), *args, **kwargs)
[2023-10-26T01:42:50.847Z]   File "/usr/local/lib/python3.10/dist-packages/papermill/cli.py", line 250, in papermill
[2023-10-26T01:42:50.847Z]     execute_notebook(
[2023-10-26T01:42:50.847Z]   File "/usr/local/lib/python3.10/dist-packages/papermill/execute.py", line 128, in execute_notebook
[2023-10-26T01:42:50.847Z]     raise_for_execution_errors(nb, output_path)
[2023-10-26T01:42:50.847Z]   File "/usr/local/lib/python3.10/dist-packages/papermill/execute.py", line 232, in raise_for_execution_errors
[2023-10-26T01:42:50.847Z]     raise error
[2023-10-26T01:42:50.847Z] papermill.exceptions.PapermillExecutionError: 
[2023-10-26T01:42:50.847Z] ---------------------------------------------------------------------------
[2023-10-26T01:42:50.847Z] Exception encountered at "In [10]":
[2023-10-26T01:42:50.847Z] ---------------------------------------------------------------------------
[2023-10-26T01:42:50.847Z] MissingSchema                             Traceback (most recent call last)
[2023-10-26T01:42:50.847Z] File /usr/local/lib/python3.10/dist-packages/clearml/backend_api/session/session.py:818, in Session._do_refresh_token(self, old_token, exp)
[2023-10-26T01:42:50.847Z]     817 try:
[2023-10-26T01:42:50.847Z] --> 818     res = self._send_request(
[2023-10-26T01:42:50.847Z]     819         method=Request.def_method,
[2023-10-26T01:42:50.847Z]     820         service="auth",
[2023-10-26T01:42:50.847Z]     821         action="login",
[2023-10-26T01:42:50.847Z]     822         auth=auth,
[2023-10-26T01:42:50.847Z]     823         headers=headers,
[2023-10-26T01:42:50.847Z]     824         refresh_token_if_unauthorized=False,
[2023-10-26T01:42:50.847Z]     825         params={"expiration_sec": exp} if exp else {},
[2023-10-26T01:42:50.847Z]     826     )
[2023-10-26T01:42:50.847Z]     827     try:
[2023-10-26T01:42:50.847Z] 
[2023-10-26T01:42:50.847Z] File /usr/local/lib/python3.10/dist-packages/clearml/backend_api/session/session.py:408, in Session._send_request(self, service, action, version, method, headers, auth, data, json, refresh_token_if_unauthorized, params)
[2023-10-26T01:42:50.847Z]     407     self._logger.debug("%s: %s [%d bytes, %d headers]", method.upper(), url, size, len(headers or {}))
[2023-10-26T01:42:50.847Z] --> 408 res = self.__http_session.request(
[2023-10-26T01:42:50.847Z]     409     method, url, headers=headers, auth=auth, data=data, json=json, timeout=timeout, params=params)
[2023-10-26T01:42:50.847Z]     410 if self._verbose and self._logger:
[2023-10-26T01:42:50.847Z] 
[2023-10-26T01:42:50.847Z] File /usr/local/lib/python3.10/dist-packages/requests/sessions.py:575, in Session.request(self, method, url, params, data, headers, cookies, files, auth, timeout, allow_redirects, proxies, hooks, stream, verify, cert, json)
[2023-10-26T01:42:50.847Z]     563 req = Request(
[2023-10-26T01:42:50.847Z]     564     method=method.upper(),
[2023-10-26T01:42:50.847Z]     565     url=url,
[2023-10-26T01:42:50.847Z]    (...)
[2023-10-26T01:42:50.847Z]     573     hooks=hooks,
[2023-10-26T01:42:50.847Z]     574 )
[2023-10-26T01:42:50.847Z] --> 575 prep = self.prepare_request(req)
[2023-10-26T01:42:50.847Z]     577 proxies = proxies or {}
[2023-10-26T01:42:50.847Z] 
[2023-10-26T01:42:50.847Z] File /usr/local/lib/python3.10/dist-packages/requests/sessions.py:486, in Session.prepare_request(self, request)
[2023-10-26T01:42:50.847Z]     485 p = PreparedRequest()
[2023-10-26T01:42:50.847Z] --> 486 p.prepare(
[2023-10-26T01:42:50.847Z]     487     method=request.method.upper(),
[2023-10-26T01:42:50.847Z]     488     url=request.url,
[2023-10-26T01:42:50.847Z]     489     files=request.files,
[2023-10-26T01:42:50.847Z]     490     data=request.data,
[2023-10-26T01:42:50.847Z]     491     json=request.json,
[2023-10-26T01:42:50.847Z]     492     headers=merge_setting(
[2023-10-26T01:42:50.847Z]     493         request.headers, self.headers, dict_class=CaseInsensitiveDict
[2023-10-26T01:42:50.847Z]     494     ),
[2023-10-26T01:42:50.847Z]     495     params=merge_setting(request.params, self.params),
[2023-10-26T01:42:50.847Z]     496     auth=merge_setting(auth, self.auth),
[2023-10-26T01:42:50.847Z]     497     cookies=merged_cookies,
[2023-10-26T01:42:50.847Z]     498     hooks=merge_hooks(request.hooks, self.hooks),
[2023-10-26T01:42:50.847Z]     499 )
[2023-10-26T01:42:50.847Z]     500 return p
[2023-10-26T01:42:50.847Z] 
[2023-10-26T01:42:50.847Z] File /usr/local/lib/python3.10/dist-packages/requests/models.py:368, in PreparedRequest.prepare(self, method, url, headers, files, data, params, auth, cookies, hooks, json)
[2023-10-26T01:42:50.847Z]     367 self.prepare_method(method)
[2023-10-26T01:42:50.847Z] --> 368 self.prepare_url(url, params)
[2023-10-26T01:42:50.847Z]     369 self.prepare_headers(headers)
[2023-10-26T01:42:50.847Z] 
[2023-10-26T01:42:50.847Z] File /usr/local/lib/python3.10/dist-packages/requests/models.py:439, in PreparedRequest.prepare_url(self, url, params)
[2023-10-26T01:42:50.847Z]     438 if not scheme:
[2023-10-26T01:42:50.847Z] --> 439     raise MissingSchema(
[2023-10-26T01:42:50.847Z]     440         f"Invalid URL {url!r}: No scheme supplied. "
[2023-10-26T01:42:50.847Z]     441         f"Perhaps you meant https://{url}?"
[2023-10-26T01:42:50.847Z]     442     )
[2023-10-26T01:42:50.847Z]     444 if not host:
[2023-10-26T01:42:50.847Z] 
[2023-10-26T01:42:50.847Z] MissingSchema: Invalid URL "''/auth.login": No scheme supplied. Perhaps you meant https://''/auth.login?
[2023-10-26T01:42:50.847Z] 
[2023-10-26T01:42:50.847Z] During handling of the above exception, another exception occurred:
[2023-10-26T01:42:50.847Z] 
[2023-10-26T01:42:50.847Z] LoginError                                Traceback (most recent call last)
[2023-10-26T01:42:50.847Z] Cell In[10], line 24
[2023-10-26T01:42:50.847Z]      21 task_name = "UNet segmentation 3d"
[2023-10-26T01:42:50.847Z]      22 project_name = "Monai example"
[2023-10-26T01:42:50.847Z] ---> 24 train_clearml_stats_handler = ClearMLStatsHandler(
[2023-10-26T01:42:50.847Z]      25     task_name=task_name, project_name=project_name, log_dir=log_dir, output_transform=lambda x: x
[2023-10-26T01:42:50.847Z]      26 )
[2023-10-26T01:42:50.847Z]      27 train_clearml_stats_handler.attach(trainer)
[2023-10-26T01:42:50.847Z] 
[2023-10-26T01:42:50.847Z] File /home/jenkins/agent/workspace/Monai-notebooks/MONAI/monai/handlers/clearml_handlers.py:115, in ClearMLStatsHandler.__init__(self, project_name, task_name, output_uri, tags, reuse_last_task_id, continue_last_task, auto_connect_frameworks, auto_connect_arg_parser, *args, **kwargs)
[2023-10-26T01:42:50.847Z]      89 def __init__(
[2023-10-26T01:42:50.848Z]      90     self,
[2023-10-26T01:42:50.848Z]      91     project_name: str | None = "MONAI",
[2023-10-26T01:42:50.848Z]    (...)
[2023-10-26T01:42:50.848Z]     100     **kwargs: Any,
[2023-10-26T01:42:50.848Z]     101 ) -> None:
[2023-10-26T01:42:50.848Z]     102     """
[2023-10-26T01:42:50.848Z]     103     Args:
[2023-10-26T01:42:50.848Z]     104         project_name: ClearML project name, default to 'MONAI'.
[2023-10-26T01:42:50.848Z]    (...)
[2023-10-26T01:42:50.848Z]     112 
[2023-10-26T01:42:50.848Z]     113     """
[2023-10-26T01:42:50.848Z] --> 115     ClearMLHandler.__init__(
[2023-10-26T01:42:50.848Z]     116         self,
[2023-10-26T01:42:50.848Z]     117         project_name=project_name,
[2023-10-26T01:42:50.848Z]     118         task_name=task_name,
[2023-10-26T01:42:50.848Z]     119         output_uri=output_uri,
[2023-10-26T01:42:50.848Z]     120         tags=tags,
[2023-10-26T01:42:50.848Z]     121         reuse_last_task_id=reuse_last_task_id,
[2023-10-26T01:42:50.848Z]     122         continue_last_task=continue_last_task,
[2023-10-26T01:42:50.848Z]     123         auto_connect_frameworks=auto_connect_frameworks,
[2023-10-26T01:42:50.848Z]     124         auto_connect_arg_parser=auto_connect_arg_parser,
[2023-10-26T01:42:50.848Z]     125     )
[2023-10-26T01:42:50.848Z]     126     TensorBoardStatsHandler.__init__(self, *args, **kwargs)
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /home/jenkins/agent/workspace/Monai-notebooks/MONAI/monai/handlers/clearml_handlers.py:66, in ClearMLHandler.__init__(self, project_name, task_name, output_uri, tags, reuse_last_task_id, continue_last_task, auto_connect_frameworks, auto_connect_arg_parser)
[2023-10-26T01:42:50.848Z]      64     self.clearml_task = clearml.Task.current_task()
[2023-10-26T01:42:50.848Z]      65 else:
[2023-10-26T01:42:50.848Z] ---> 66     self.clearml_task = clearml.Task.init(
[2023-10-26T01:42:50.848Z]      67         project_name=project_name,
[2023-10-26T01:42:50.848Z]      68         task_name=task_name,
[2023-10-26T01:42:50.848Z]      69         output_uri=output_uri,
[2023-10-26T01:42:50.848Z]      70         tags=tags,
[2023-10-26T01:42:50.848Z]      71         reuse_last_task_id=reuse_last_task_id,
[2023-10-26T01:42:50.848Z]      72         continue_last_task=continue_last_task,
[2023-10-26T01:42:50.848Z]      73         auto_connect_frameworks=auto_connect_frameworks,
[2023-10-26T01:42:50.848Z]      74         auto_connect_arg_parser=auto_connect_arg_parser,
[2023-10-26T01:42:50.848Z]      75     )
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/task.py:563, in Task.init(cls, project_name, task_name, task_type, tags, reuse_last_task_id, continue_last_task, output_uri, auto_connect_arg_parser, auto_connect_frameworks, auto_resource_monitoring, auto_connect_streams, deferred_init)
[2023-10-26T01:42:50.848Z]     561 elif not is_sub_process_task_id:
[2023-10-26T01:42:50.848Z]     562     try:
[2023-10-26T01:42:50.848Z] --> 563         task = cls._create_dev_task(
[2023-10-26T01:42:50.848Z]     564             default_project_name=project_name,
[2023-10-26T01:42:50.848Z]     565             default_task_name=task_name,
[2023-10-26T01:42:50.848Z]     566             default_task_type=task_type,
[2023-10-26T01:42:50.848Z]     567             tags=tags,
[2023-10-26T01:42:50.848Z]     568             reuse_last_task_id=reuse_last_task_id,
[2023-10-26T01:42:50.848Z]     569             continue_last_task=continue_last_task,
[2023-10-26T01:42:50.848Z]     570             detect_repo=False if (
[2023-10-26T01:42:50.848Z]     571                     isinstance(auto_connect_frameworks, dict) and
[2023-10-26T01:42:50.848Z]     572                     not auto_connect_frameworks.get('detect_repository', True)) else True,
[2023-10-26T01:42:50.848Z]     573             auto_connect_streams=auto_connect_streams,
[2023-10-26T01:42:50.848Z]     574         )
[2023-10-26T01:42:50.848Z]     575     except MissingConfigError as e:
[2023-10-26T01:42:50.848Z]     576         if not ENV_IGNORE_MISSING_CONFIG.get():
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/task.py:3529, in Task._create_dev_task(cls, default_project_name, default_task_name, default_task_type, tags, reuse_last_task_id, continue_last_task, detect_repo, auto_connect_streams)
[2023-10-26T01:42:50.848Z]    3527 # create a new task
[2023-10-26T01:42:50.848Z]    3528 if not default_task_id:
[2023-10-26T01:42:50.848Z] -> 3529     task = cls(
[2023-10-26T01:42:50.848Z]    3530         private=cls.__create_protection,
[2023-10-26T01:42:50.848Z]    3531         project_name=default_project_name,
[2023-10-26T01:42:50.848Z]    3532         task_name=default_task_name,
[2023-10-26T01:42:50.848Z]    3533         task_type=default_task_type,
[2023-10-26T01:42:50.848Z]    3534         log_to_backend=True,
[2023-10-26T01:42:50.848Z]    3535     )
[2023-10-26T01:42:50.848Z]    3536     # no need to reload yet, we clear this before the end of the function
[2023-10-26T01:42:50.848Z]    3537     task._reload_skip_flag = True
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/task.py:206, in Task.__init__(self, private, **kwargs)
[2023-10-26T01:42:50.848Z]     202     raise UsageError(
[2023-10-26T01:42:50.848Z]     203         'Task object cannot be instantiated externally, use Task.current_task() or Task.get_task(...)')
[2023-10-26T01:42:50.848Z]     204 self._repo_detect_lock = threading.RLock()
[2023-10-26T01:42:50.848Z] --> 206 super(Task, self).__init__(**kwargs)
[2023-10-26T01:42:50.848Z]     207 self._arguments = _Arguments(self)
[2023-10-26T01:42:50.848Z]     208 self._logger = None
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/backend_interface/task/task.py:161, in Task.__init__(self, session, task_id, log, project_name, task_name, task_type, log_to_backend, raise_on_validation_errors, force_create)
[2023-10-26T01:42:50.848Z]     159 task_id = self._resolve_task_id(task_id, log=log) if not force_create else None
[2023-10-26T01:42:50.848Z]     160 self.__edit_lock = None
[2023-10-26T01:42:50.848Z] --> 161 super(Task, self).__init__(id=task_id, session=session, log=log)
[2023-10-26T01:42:50.848Z]     162 self._project_name = None
[2023-10-26T01:42:50.848Z]     163 self._storage_uri = None
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/backend_interface/base.py:149, in IdObjectBase.__init__(self, id, session, log, **kwargs)
[2023-10-26T01:42:50.848Z]     148 def __init__(self, id, session=None, log=None, **kwargs):
[2023-10-26T01:42:50.848Z] --> 149     super(IdObjectBase, self).__init__(session, log, **kwargs)
[2023-10-26T01:42:50.848Z]     150     self._data = None
[2023-10-26T01:42:50.848Z]     151     self._id = None
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/backend_interface/base.py:41, in InterfaceBase.__init__(self, session, log, **kwargs)
[2023-10-26T01:42:50.848Z]      39 def __init__(self, session=None, log=None, **kwargs):
[2023-10-26T01:42:50.848Z]      40     super(InterfaceBase, self).__init__()
[2023-10-26T01:42:50.848Z] ---> 41     self._session = session or self._get_default_session()
[2023-10-26T01:42:50.848Z]      42     self._log = log or self._create_log()
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/backend_interface/base.py:119, in InterfaceBase._get_default_session(cls)
[2023-10-26T01:42:50.848Z]     116 @classmethod
[2023-10-26T01:42:50.848Z]     117 def _get_default_session(cls):
[2023-10-26T01:42:50.848Z]     118     if not InterfaceBase._default_session:
[2023-10-26T01:42:50.848Z] --> 119         InterfaceBase._default_session = Session(
[2023-10-26T01:42:50.848Z]     120             initialize_logging=False,
[2023-10-26T01:42:50.848Z]     121             config=config_obj,
[2023-10-26T01:42:50.848Z]     122             api_key=ENV_ACCESS_KEY.get(),
[2023-10-26T01:42:50.848Z]     123             secret_key=ENV_SECRET_KEY.get(),
[2023-10-26T01:42:50.848Z]     124         )
[2023-10-26T01:42:50.848Z]     125     return InterfaceBase._default_session
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/backend_api/session/session.py:157, in Session.__init__(self, worker, api_key, secret_key, host, logger, verbose, config, http_retries_config, **kwargs)
[2023-10-26T01:42:50.848Z]     154     from clearml.config import ConfigWrapper
[2023-10-26T01:42:50.848Z]     155     self.config = ConfigWrapper._init()
[2023-10-26T01:42:50.848Z] --> 157 self._connect()
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/backend_api/session/session.py:224, in Session._connect(self)
[2023-10-26T01:42:50.848Z]     217     raise MissingConfigError()
[2023-10-26T01:42:50.848Z]     219 super(Session, self).__init__(
[2023-10-26T01:42:50.848Z]     220     **self.__token_manager_kwargs,
[2023-10-26T01:42:50.848Z]     221     token_expiration_threshold_sec=token_expiration_threshold_sec,
[2023-10-26T01:42:50.848Z]     222     req_token_expiration_sec=req_token_expiration_sec
[2023-10-26T01:42:50.848Z]     223 )
[2023-10-26T01:42:50.848Z] --> 224 self.refresh_token()
[2023-10-26T01:42:50.848Z]     226 local_logger = self._LocalLogger(self._logger)
[2023-10-26T01:42:50.848Z]     228 # update api version from server response
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/backend_api/session/token_manager.py:112, in TokenManager.refresh_token(self)
[2023-10-26T01:42:50.848Z]     111 def refresh_token(self):
[2023-10-26T01:42:50.848Z] --> 112     self._set_token(self._do_refresh_token(self.__token, exp=self.req_token_expiration_sec))
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] File /usr/local/lib/python3.10/dist-packages/clearml/backend_api/session/session.py:857, in Session._do_refresh_token(self, old_token, exp)
[2023-10-26T01:42:50.848Z]     854         raise LoginError("Response data mismatch: No 'token' in 'data' value from res, receive : {}, "
[2023-10-26T01:42:50.848Z]     855                          "exception: {}".format(res, ex))
[2023-10-26T01:42:50.848Z]     856 except Exception as ex:
[2023-10-26T01:42:50.848Z] --> 857     raise LoginError('Unrecognized Authentication Error: {} {}'.format(type(ex), ex))
[2023-10-26T01:42:50.848Z] 
[2023-10-26T01:42:50.848Z] LoginError: Unrecognized Authentication Error: <class 'requests.exceptions.MissingSchema'> Invalid URL "''/auth.login": No scheme supplied. Perhaps you meant https://''/auth.login?

cc @pollfly

Start with experiment_management/unet_segmentation_3d_ignite_clearml.ipynb and cell In [10], where ClearMLStatsHandler triggers the MissingSchema error. Run the notebook with the same Papermill setup and inspect the ClearML configuration implicated by the empty URL in the traceback. Done means the notebook completes without a PapermillExecutionError.