aws-samples / aws-samples/sagemaker-studio-custom-image-samples

exec /opt/.sagemakerinternal/conda/kgw_variant: exec format error

Open
#28 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
136
Forks
90
PR merge metrics
No merged PRs in 30d

Description

I've been trying to use my own custom image in SageMaker Studio and I always get the same error when trying to associate a notebook to the kernel (as seen in SageMaker Studio) :

```
Failed to start kernel
Failed to launch app [xxxxxxx-ml-t3-medium-176855f5e1df73edeeb33d0c81f0]. InternalFailure
```

And, the only log event seen in CloudWatch for the image is:

`exec /opt/.sagemakerinternal/conda/kgw_variant: exec format error.`

At first I thought it might be a bug in my container, so I have carefully checked all the steps described in [DEVELOPMENT.md](https://github.com/aws-samples/sagemaker-studio-custom-image-samples/blob/main/DEVELOPMENT.md).

And finally, to try to discard a bug in the platform I tried to use the examples
[echo-kernel-image](https://github.com/aws-samples/sagemaker-studio-custom-image-samples/tree/main/examples/echo-kernel-image) and [python-poetry-image](https://github.com/aws-samples/sagemaker-studio-custom-image-samples/tree/main/examples/python-poetry-image) without modifications from the repository and in both of them **the same error occurred**.

I have also tried the [tf23-image](https://github.com/aws-samples/sagemaker-studio-custom-image-samples/tree/main/examples/tf23-image) example, and it works, so I have been comparing the images and my feeling is that it could be related to the base image (the operating system used in the container): [echo-kernel-image](https://github.com/aws-samples/sagemaker-studio-custom-image-samples/tree/main/examples/echo-kernel-image) and [python-poetry-image](https://github.com/aws-samples/sagemaker-studio-custom-image-samples/tree/main/examples/python-poetry-image) are based on `debian` and [tf23-image](https://github.com/aws-samples/sagemaker-studio-custom-image-samples/tree/main/examples/tf23-image) is based on `ubuntu`. Could that be the issue?

Could you please confirm that [echo-kernel-image](https://github.com/aws-samples/sagemaker-studio-custom-image-samples/tree/main/examples/echo-kernel-image) and [python-poetry-image](https://github.com/aws-samples/sagemaker-studio-custom-image-samples/tree/main/examples/python-poetry-image) images are working (as is) in current SageMaker Studio version?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.