coder / coder/xum

Improve cost segregation for different tasks within a workspace

Open
#1,821 3 comments 0 reactions 0 assignees View on GitHub
enhancement investigation
Dominant language
TypeScript
Stars
2k
Forks
134
Avg merge
14h 57m
Merged PRs (30d)
307

Description

Re https://github.com/coder/mux/pull/1658#issuecomment-3775922643 and https://news.ycombinator.com/item?id=46695415#46699650

Currently, Mux workspace costs are presented as an entire sum of costs all requests in that workspace, with no consideration for specific tasks, PRs, or commits. This leads to:

- Misleading costs on external artifacts such as PRs
- A conflicting incentive for long-lived workspaces:
- From a context perspective, it's often more efficient to compact and continue with an existing workspace to work on related tasks
- From a cost reporting perspective, it's more efficient to create fresh workspaces often

Idea: feed cumulative and last-request costs as synthetic messages to the LLM, perhaps the LLM will generally be smart enough to know to only include costs from message B to message C if message A had little to do with a PR.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.