aws-samples / aws-samples/fm-evaluation-at-scale

Failed to read serialized bytes function/metadata.json

Open
#7 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
30
Forks
10
PR merge metrics
No merged PRs in 30d

Description

I tried to run the `llm-evaluation-single-model` pipeline, but it failed in the `evaluation_meta-textgeneration-llama-2-7b` step with the following error:

` sagemaker.remote_function.errors.ServiceError: Failed to read serialized bytes from s3://sagemaker-ap-southeast-1-REDACTED/llm-evaluation-single-model/function/metadata.json: ClientError('An error occurred (404) when calling the HeadObject operation: Not Found')`

Specifically, it is unable to deserialize `s3://sagemaker-ap-southeast-1-REDACTED/llm-evaluation-single-model/function/metadata.json` because this file does not exist. I do find a `function/metadata.json` in the following location `s3://sagemaker-ap-southeast-1-REDACTED/llm-evaluation-single-model/evaluation_meta-textgeneration-llama-2-7b/2024-01-16-22-00-44-355/function/metadata.json` but I'm not sure if it is the correct file.

It looks like there is an issue with S3 prefixes for the code in this sample. I ran the code as-is, making no changes to it except for commenting the role line in config.yaml (see other open issue).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.