dotnet / dotnet/machinelearning

Please make a simple way using the local gguf model, thanks

Open
#7,003 2 comments 0 reactions 0 assignees View on GitHub
area-GenAI enhancement needs-further-triage untriaged
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

add a simple feature in one line
load the model into memory like python does
what is your problem create a simple way to download
models from huggingface? quantized up to 4 or 5 Q
for example mistralai/Mistral-7B-v0.1
gguf extensions
Can you explain the difficulties, why you are not addressing this issue, for example, I don’t like python and I don’t want to use it, but due to the fact that you do not support the way of loading a model and communicating with it in ml net, I have to use it
Please make a simple way using the local gguf model, thanks

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.