pymc-devs / pymc-devs/ptgp

Skills files for GP methods: diagnostics, failure modes, and folk wisdom

Open
#12 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Jupyter Notebook
Stars
8
Forks
4
Avg merge
2d 2h
Merged PRs (30d)
4

Description

ptgp ships a skill file for VFE (.claude/skills/ptgp-vfe/) that describes when to use VFE, how to diagnose training issues, common failure modes, and tips for getting good results. It would be good to have similar skills for other GP methods (SVGP, exact GP, VFF, spherical harmonics, etc.).

These skills capture the kind of knowledge that's hard to put in a docstring: when to use which approximation, what to check when training goes wrong, folk wisdom about initialization and hyperparameter choices.

Another area where skills could help is setting priors on kernel hyperparameters. Choosing priors for lengthscale, amplitude, and noise is one of the trickiest parts of GP modeling for practitioners, and the right choices depend heavily on the data and the problem. A skill that encodes guidance on prior selection (e.g. how to think about lengthscale relative to input range, when to use informative vs. weakly informative priors on sigma) would be valuable.

One possibility: skills could be used to help generate "choose your own adventure" style documentation. With skills handling the interactive, problem-specific guidance, documentation wouldn't need to be exhaustive and prescriptive. Instead it could be short, succinct case studies that don't have to go into the weeds of debugging or the use of every utility and helper. The skills files would be especially useful for users working with an LLM to plan and discuss how to solve their particular modeling problem.

Open questions

  • How should skills be installed for users? Currently they live in the repo under .claude/skills/. What's the right distribution mechanism?
  • What methods should have their own skill file?
  • What should the skills cover beyond what the VFE skill already does?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the existing .claude/skills/ptgp-vfe/ skill to understand its coverage and structure. Clarify which GP methods and prior-selection guidance are in scope, how skills should be distributed, and what agreed set of completed skill files would constitute done.

Written by the indexing model from the issue text.

Assessment

Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.