List Of Supported Models For DeepSpeed Inference; Add MPT And Falcon Inference Support[REQUEST]

Is your feature request related to a problem? Please describe.

DeepSpeed inference is one of the best and or easiest ways to speed up LLM inference. However, with all the models coming out, it's not clear what models are supported. It would be great to either have documentation or some other tool that lists what models are supported.

Additionally, at this time, it seems to me that Falcon and MPT models are the best open-source commercial-friendly LLMs. Falcon for short context, MPT for long context(thanks to Alibi)

Describe the solution you'd like

Clear documentation of the method within DeepSpeed inference that lists what models are supported.

Additionally, if not already supported, add support for the best LLMs at this time, that being MPT and Falcon

Describe alternatives you've considered

If I understand the documentation, I think I can manually map some parts of these models with some of the kernel optimizations. Some of the kernels are likely compatible with Falcon and MPT. However, it would be nice if it was automatically supported like GPTJ.

I also thought about reading the source code to determine what models are supported but that's not ideal.

Start with the DeepSpeed inference documentation and source code, the entry points identified in the issue, to determine how supported models are currently represented. Define the supported-model list and assess what MPT and Falcon support would require; done means the documentation is clear and any added support is covered consistently.