ianarawjo / ianarawjo/ChainForge

Add logs inside inspector view

Open
#226 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
3k
Forks
256
Avg merge
4h 40m
Merged PRs (30d)
22

Description

In some cases, it is useful to see the logs of an evaluator node to understand where the score comes from. A button with that log could be added next to the score in the inspector view. For example, when running test cases on the output of an llvm, it can be useful to access the information of what test passed/failed and the error message.

The log button inside the inspector should open a new window with the logs (if they are too big). For my use-case, they are quite big, so a new window would be preferable. This would considerably speed up my workflow:)

Here is a rough sketch of what it could look like :

![image](https://github.com/ianarawjo/ChainForge/assets/10509670/b62d687d-bcf1-475f-9b10-f6aa92810138)

Thanks for the amazing tool !

Contributor guide

No contributing guide indexed for this repository

Research direction

Locate the inspector view and the evaluator-node score entry point, then trace how evaluator output and logs are currently exposed. Confirm how large logs should be displayed in a separate window. Done means the inspector offers access to an evaluator's logs, including useful test results and error messages.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
frontend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.