dotnet / dotnet/machinelearning

More tighter integration of OpenAI models with ML.NET

Open
#6,600 9 comments 4 reactions 0 assignees View on GitHub
area-GenAI enhancement Priority:3
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

**Is your feature request related to a problem? Please describe.**
MIcrosoft has a strong alliance with OpenAI. Our expectation is that we should be able to easily get these models say from Model Zoo of Azure (similar HuggingFace) and use them in our application.

**Describe the solution you'd like**
1) Download and Save a GPT model in a very compressed format
2) on the first access, uncompress and cache the model file. I expect it to be huge
3) Like the GPT API provided by open AI, provide precise input and output objects.
4) Source application will fill in the request object and invoke the model as if it was an resource like database. It will receive the response which it will process

**Describe alternatives you've considered**
1) Calling API of OpenAI
2) Trying to use model from HuggingFace. I did not how to do this

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.