Skills files for GP methods: diagnostics, failure modes, and folk wisdom
Nobody has claimed this yet.
- Dominant language
- Jupyter Notebook
- Stars
- 8
- Forks
- 4
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 4
Description
ptgp ships a skill file for VFE (.claude/skills/ptgp-vfe/) that describes when to use VFE, how to diagnose training issues, common failure modes, and tips for getting good results. It would be good to have similar skills for other GP methods (SVGP, exact GP, VFF, spherical harmonics, etc.).
These skills capture the kind of knowledge that's hard to put in a docstring: when to use which approximation, what to check when training goes wrong, folk wisdom about initialization and hyperparameter choices.
Another area where skills could help is setting priors on kernel hyperparameters. Choosing priors for lengthscale, amplitude, and noise is one of the trickiest parts of GP modeling for practitioners, and the right choices depend heavily on the data and the problem. A skill that encodes guidance on prior selection (e.g. how to think about lengthscale relative to input range, when to use informative vs. weakly informative priors on sigma) would be valuable.
One possibility: skills could be used to help generate "choose your own adventure" style documentation. With skills handling the interactive, problem-specific guidance, documentation wouldn't need to be exhaustive and prescriptive. Instead it could be short, succinct case studies that don't have to go into the weeds of debugging or the use of every utility and helper. The skills files would be especially useful for users working with an LLM to plan and discuss how to solve their particular modeling problem.
Open questions
- How should skills be installed for users? Currently they live in the repo under
.claude/skills/. What's the right distribution mechanism? - What methods should have their own skill file?
- What should the skills cover beyond what the VFE skill already does?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the existing .claude/skills/ptgp-vfe/ skill to understand its coverage and structure. Clarify which GP methods and prior-selection guidance are in scope, how skills should be distributed, and what agreed set of completed skill files would constitute done.
Written by the indexing model from the issue text.
Assessment
- Domain
- documentation, machine-learning
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100