Azure / Azure/MachineLearningNotebooks

Parallel run example fail when executing with deserialization error

Open
#1,961 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
4.4k
Forks
2.6k
PR merge metrics
No merged PRs in 30d

Description

I am trying to run a python script on multiple data inputs parallel, for this i am using the batch processing examples provided in this repo. Specifically I am looking at this one: https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/machine-learning-pipelines/parallel-run/file-dataset-partition-per-folder.ipynb

Running the exact same script initially generates a lot of value error saying "This pipeline didn't have the RawDeserializer policy; can't deserialize" (screenshot 1) and finally raises the Image build failed error (screenshot 2). I cannot find anything at the logfile mentioned in the error code. I have tried using the same environment from my azureml vm but that also didn't help.

Can someone kindly help?

![image](https://github.com/Azure/MachineLearningNotebooks/assets/64039635/14fae036-83a1-4e18-87b2-a1c8e42cbbc3)

![Screenshot 2024-04-10 at 17 58 37](https://github.com/Azure/MachineLearningNotebooks/assets/64039635/38644a70-fa37-4c12-93f1-141361b148ac)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.