dotnet / dotnet/machinelearning

Add support/examples for Google Gemma lightweight LLM models

Open
#7,026 1 comment 0 reactions 0 assignees View on GitHub
area-GenAI enhancement untriaged
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

**Is your feature request related to a problem? **
Support complex LLM reasoning tasks with ML .NET. My specific use case here is structured data extraction into a known format.

Being able to take this models and fine tune them using the ML .NET training/pipeline APIs would be a huge benefit.

**Describe the solution you'd like**
Google have opened sourced their base model Gemma which is a lightlight deriviative of the Gemini LLM. There is a keras implementation of it, a TensorFlow implementation. There are other options available but they havent been instruction tuned so the model would need more work for say, pytorch?

**Additional context**
https://blog.google/technology/developers/gemma-open-models/
https://www.kaggle.com/models/google/gemma

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.