aws-samples / aws-samples/fm-evaluation-at-scale
Failed to read serialized bytes function/metadata.json
- Dominant language
- Jupyter Notebook
- Stars
- 30
- Forks
- 10
- PR merge metrics
- No merged PRs in 30d
Description
I tried to run the `llm-evaluation-single-model` pipeline, but it failed in the `evaluation_meta-textgeneration-llama-2-7b` step with the following error:
` sagemaker.remote_function.errors.ServiceError: Failed to read serialized bytes from s3://sagemaker-ap-southeast-1-REDACTED/llm-evaluation-single-model/function/metadata.json: ClientError('An error occurred (404) when calling the HeadObject operation: Not Found')`
Specifically, it is unable to deserialize `s3://sagemaker-ap-southeast-1-REDACTED/llm-evaluation-single-model/function/metadata.json` because this file does not exist. I do find a `function/metadata.json` in the following location `s3://sagemaker-ap-southeast-1-REDACTED/llm-evaluation-single-model/evaluation_meta-textgeneration-llama-2-7b/2024-01-16-22-00-44-355/function/metadata.json` but I'm not sure if it is the correct file.
It looks like there is an issue with S3 prefixes for the code in this sample. I ran the code as-is, making no changes to it except for commenting the role line in config.yaml (see other open issue).
Contributor guide
Assessment
This issue has not been assessed yet.