Hosting llama2 13b chat model using torch serve on inf2

[1]https://github.com/aws/amazon-sagemaker-examples-community/blob/main/torchserve/inf2/llama2/llama-2-13b.ipynb

Was able to run the notebook successfully for llama2 13b.

Followed instructions to create artifacts for llama2 13b chat model, saved them in model_store/.., and ran inference to test.

While utilizing the notebook[1] to run the 13b chat model instead of the base model, getting a timeout error.
ReadTimeoutError: Read timeout on endpoint URL: "https://runtime.sagemaker.us-west-2.amazonaws.com/endpoints/.."

All other params are the same except tp_degree. I have used tp_degree=12 instead of 6 to utilize all cores on inf2.24x.

Open the linked torchserve/inf2/llama2/llama-2-13b.ipynb and compare the successful base-model path with the 13b chat-model path, especially the tp_degree=12 configuration and endpoint invocation. Reproduce the SageMaker inference request, with successful completion without a ReadTimeoutError as the done condition.

Written by the indexing model from the issue text.