config.json file not found when loading model from AWS S3 bucket.

Ok, so I am trying to deploy this model : https://huggingface.co/sshleifer/distilbart-cnn-12-6 with a custom inference.py to an endpoint on Amazon Web Services. First, however, I am trying to deploy it as is to before I add the custom inference.py file.

I will step you through the steps I have taken so far in hopes that you can tell me what I am doing wrong.

1) Download the model files using git clone https://huggingface.co/sshleifer/distilbart-cnn-12-6

2)Compress the 5.2gb model into a model.tar.gz using the command 'tar -czf model.tar.gz distilbart-cnn-12-6'

3)Upload the model.tar.gz to my s3 bucket

4)Deploy my model using this script


Whenever I run this, the endpoint successfully deploys. However when I try to run a prediction using

`predictor.predict({
'inputs': "The tower is 324 metres (1,063 ft) tall, about the same height as an 81-storey building, and the tallest structure in Paris. Its base is square, measuring 125 metres (410 ft) on each side. During its construction, the Eiffel Tower surpassed the Washington Monument to become the tallest man-made structure in the world, a title it held for 41 years until the Chrysler Building in New York City was finished in 1930. It was the first structure to reach a height of 300 metres. Due to the addition of a broadcasting aerial at the top of the tower in 1957, it is now taller than the Chrysler Building by 5.2 metres (17 ft). Excluding transmitters, the Eiffel Tower is the second tallest free-standing structure in France after the Millau Viaduct."
})`

I get an error telling me on my aws logs

`2021-07-22 16:02:37,654 [INFO ] W-model-1-stdout com.amazonaws.ml.mms.wlm.WorkerLifeCycle - ValueError: ("You need to define one of the following ['feature-extraction', 'text-classification', 'token-classification', 'question-answering', 'table-question-answering', 'fill-mask', 'summarization', 'translation', 'text2text-generation', 'text-generation', 'zero-shot-classification', 'conversational', 'image-classification'] as env 'TASK'.", 403)`

So I went into the source code here and found this section:

So for some reason, my json.config file is not loading. I think it has something to do with the model directory not being in the right place and I am kind of lost. Any help would be much appreciated!!!

Start with the AWS deployment script, the config.json loading code shown in the screenshots, and the model.tar.gz layout described in the issue. Reproduce the predictor.predict call and inspect the AWS logs for why TASK is unset. Done means the endpoint loads the model and accepts the prediction request without this error.

Written by the indexing model from the issue text.