posit-dev / posit-dev/py-shiny

Example app for labelling LLM responses

Open
#744 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
1.8k
Forks
135
Avg merge
2d 18h
Merged PRs (30d)
21

Description

LLM researchers have a common task where they need to review the output of LLMs and either accept, reject, or skip each item. We can put together a quick example to illustrate that pattern.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No file, test, or entry point is named. Start by reviewing the repository's existing example apps and determine where a new Shiny example belongs; done means an example that demonstrates reviewing LLM outputs with accept, reject, and skip choices.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, web-dev
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.