microsoft / microsoft/vscode

Prompt Caching Expiration shown in Session/Chat

Open
#324,292 0 comments 1 reaction 1 assignee Claimed by @justschen View on GitHub
Dominant language
TypeScript
Stars
193k
Forks
42.4k
PR merge metrics
PR metrics pending

Description

Since parallel running Sessions and Chats is very common and Costs have risen, managing Tokens and therefore Cache hits is very important.

It would be very useful to know for every response how long this is cached.

- When is the cache lost
- Show this on Session info in the sessions list
- show this in the Session

This would allow taking care which session to prioritize.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.