ianarawjo / ianarawjo/ChainForge

Visualize "style" of LLM responses across particular questions

Open
#36 0 comments 0 reactions 0 assignees View on GitHub
future feature low priority
Dominant language
TypeScript
Stars
3k
Forks
256
Avg merge
4h 40m
Merged PRs (30d)
22

Description

Right now, users have to glance at responses manually in an `InspectNode` to gleam how LLMs differ. This becomes difficult especially for large quantities of responses where num responses per prompt `n > 1`. Ideally, there should be a way to visualize the "style" of a particular LLM response (for particular sets of input prompts and prompt parameters). This involves designing, or adopting, a kind of aggregate text visualization and aggregation technique that presents the 'style' of responses per set.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.