Azure / Azure/MachineLearningNotebooks

AzureML Compute Job failed to start

Aberta
#1,389 4 comentários 0 reações 0 responsáveis Ver no GitHub
ADO Compute product-issue
Linguagem predominante
Jupyter Notebook
Estrelas
4.4k
Forks
2.6k
Métricas de merge de PRs
Nenhum PR com merge em 30d

Descrição

Unable to use dockerfile to create an Environment in the `explain-model-on-amlcompute.ipynb` notebook.

The following is the code

```
from azureml.core import Workspace, Environment
myenv = Environment(name="rapidsenv")

myenv.register(workspace=ws)
myenv.docker.enabled=True

dockerfile = r"""
FROM rapidsai/rapidsai-cloud-ml:0.17-cuda11.0-base-ubuntu18.04-py3.8
RUN echo "success" # I'd like to install different packages here
"""
myenv.docker.base_image = None
myenv.docker.base_dockerfile = dockerfile
myenv.python.user_managed_dependencies=True

from azureml.core import Run
from azureml.core import ScriptRunConfig

src = ScriptRunConfig(source_directory=project_folder,
script='train_explain.py',
compute_target=gpu_cluster,
environment=myenv)
run = experiment.submit(config=src)
run
```

This is what shows up on the Portal.

```
AzureMLCompute job failed.
JobContainerConfigFailed: Container configuration failed unexpectedly
JobContainerConfigFailed: Container configuration failed unexpectedly
err: Docker exec failure when attempting to execute 'containerSetup' task. Error: exit status 126. Indicates a command was found but not executable, likely due to permission issues or missing dependencies.
Reason: Docker exec failure when attempting to execute 'containerSetup' task. Error: exit status 126. Indicates a command was found but not executable, likely due to permission issues or missing dependencies.
Info: Failed to prepare an environment for the job execution: Job environment preparation failed on 10.0.0.4 with err exit status 1.
```

How do I resolve this issue?

Guia de contribuição

Nenhum guia de contribuição indexado para este repositório

Direção de pesquisa

Comece com explain-model-on-amlcompute.ipynb e execute o exemplo fornecido de Environment e ScriptRunConfig no GPU compute target. Use as mensagens JobContainerConfigFailed e containerSetup exit-status-126 do Portal para rastrear a preparação do ambiente; considera-se concluído quando o job do notebook é iniciado com sucesso usando o ambiente baseado em Dockerfile.

Escrita pelo modelo de indexação a partir do texto da issue.

Avaliação

Stack de tecnologia
azure, docker, jupyter-notebook, python
Domínio
cloud, devops, machine-learning
Tipo de issue
Bug
Dificuldade
4/5
Tempo estimado
3-5 dias
Status de atividade
Estagnada
Clareza
Razoavelmente clara
Facilidade para iniciantes
35/100

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.