huggingface / huggingface/upskill

Add LiteLLM or llama.cpp support to Generate skills

Open
#23 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
746
Forks
91
PR merge metrics
No merged PRs in 30d

Description

So far, only models like Anthropic or OpenAI are available for the generation of skills. I noticed that Eval has a way to load custom models and use them for evaluation. However, it doesn't seem possible to use custom models to `generate` skills. I'd like to have support to also add open source models or custom models to generate skills as oppose to proprietary only.

```bash
# Evaluate on local model (llama.cpp server)
upskill generate "parse YAML" \
--eval-model "unsloth/GLM-4.7-Flash-GGUF:Q4_0" \
--eval-base-url http://localhost:8080/v1
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.