ianarawjo / ianarawjo/ChainForge
Create tutorials on common use cases and update docs
- Dominant language
- TypeScript
- Stars
- 3k
- Forks
- 256
- Avg merge
- 4h 40m
- Merged PRs (30d)
- 22
Description
ChainForge is great for rapid prototyping and sensemaking of LLM outputs across prompts and models. However, this "rapid evaluation" is lost in its name.
To help this problem, I suggest creating dual blog posts-video tutorials on common use cases (see https://x.com/allafarce/status/1731816710250897658?s=20). The two most common are:
- evaluating across prompt templates, showcasing template chaining and Table View
- evaluating across multiple LLMs, for instance PRO models hosted on HuggingFace versus Claude-2
We should also update docs. There have been some nodes added to ChainForge, and the CSV Node has been renamed to Items Node. These changes should be reflected in the docs.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing the current ChainForge documentation and the existing material for template chaining, Table View, the Items Node, and the listed LLM use cases. Use the linked example for context, and consider the work complete when both tutorial flows and the documentation updates cover the renamed node and newer nodes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface, typescript
- Domain
- ai, documentation
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100