dotnet / dotnet/machinelearning

Add GenAI packages

Open
#7,169 16 comments 5 reactions 0 assignees View on GitHub
area-GenAI enhancement untriaged
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

**Describe the solution you'd like**
The `GenAI` packages will provide torchsharp implementation for a series of popular GenAI models. The goal is to load the same weight from the corresponding python regular model.

- [x] Add design doc (#7170)
- [x] Add `Microsoft.ML.GenAI.Core` (#7177)

The following models will be added in the first wave
- [x] Phi-3 (`Microsoft.ML.GenAI.Phi`) #7184
- [x] Add README to `Microsoft.ML.GenAI.Phi` project #7206
- [x] LLaMA (`Microsoft.ML.GenAI.LLaMA`) #7220
- [ ] Mistral (`Microsoft.ML.GenAI.Mistral`)
- [x] Mistral-7b-instruct v3
- [ ] Mistral-nemo
- [x] Generate Embedding from CausalLMModel #7227
- [ ] Stable Diffusion (`Microsoft.ML.GenAI.StableDiffusion`)

MEAI intergration
- [x] Add CausalLMPipelineChatClient #7270

Fine-tuning #7287

Along with the benchmark
- [ ] Benchmark for Phi-3

- [ ] Flash Attention support #7238

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.