Conversational Agent with Llama-2-70b-chat-hf

Hi there,

Anyone here managed to get the conversational agent published in the following article working with the Petals?
https://www.pinecone.io/learn/llama-2/

I created the following notebook based on the notebook of the article above and run it in my Ubuntu Linux workstation without GPU, the conversational agent failed to work. I not sure the discrepancies between the Petals runtime with the one of the original notebook, kindly let's me know if you know anything missing here:
https://github.com/limcheekin/langchain-playground/blob/main/llama-2-chat-agent.ipynb
(You can click the "Open in Colab" or "Open nbviewer" link on top of the notebook to check out the original notebook)

Feel free to download the notebook and the custom Petals class and try it out yourself, appreciate if you could share your outcome here and the changes you made.

I'd love to hear from you! :)