dotnet / dotnet/machinelearning
Please make a simple way using the local gguf model, thanks
Open
area-GenAI
enhancement
needs-further-triage
untriaged
- Dominant language
- C#
- Stars
- 9.4k
- Forks
- 2k
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 11
Description
add a simple feature in one line
load the model into memory like python does
what is your problem create a simple way to download
models from huggingface? quantized up to 4 or 5 Q
for example mistralai/Mistral-7B-v0.1
gguf extensions
Can you explain the difficulties, why you are not addressing this issue, for example, I don’t like python and I don’t want to use it, but due to the fact that you do not support the way of loading a model and communicating with it in ml net, I have to use it
Please make a simple way using the local gguf model, thanks
Contributor guide
Assessment
This issue has not been assessed yet.