PAIR-code / PAIR-code/deliberate-lab

Add logging, frontend editor options for using message format (not string prompt) for API calls

Open
#674 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

runtime:agents runtime:experimenter-ux stale
Dominant language
TypeScript
Stars
96
Forks
40
Avg merge
2d 11h
Merged PRs (30d)
20

Description

PR #668 adds the ability to send an array of encoded messages as the prompt (rather than the usual "Deliberate Lab structured prompt" converted to a string) when calling APIs. Right now, this is hardcoded so that the message format is used specifically for private chat stages with 1 participant, 1 mediator.

We'll want experimenters to be able to configure regular prompt vs. message format (e.g., so that it's clear in the experiment editor and the prompt preview is correct) as well as view this in API logging.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing PR #668 and tracing how prompt format is selected for private chat API calls. Then locate the experiment editor, prompt preview, and API logging entry points; done means experimenters can choose regular prompt or message format, the preview reflects that choice, and logs show the selected format.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
api, frontend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.