coder / coder/aibridge

Decided how/if to make data retention on provider side configurable in AI Bridge

Open
#79 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
39
Forks
7
PR merge metrics
No merged PRs in 30d

Description

OpenAI allows to configure if request will be stored or not on the provider side:
* responses (default true): https://platform.openai.com/docs/api-reference/responses/create#responses_create-store
* chat completions (default false): https://platform.openai.com/docs/api-reference/chat/create#chat_create-store

It is possible to retrieve both chat completions or responses though API
* responses: https://platform.openai.com/docs/api-reference/responses/get
* chat completions: https://platform.openai.com/docs/api-reference/chat/get

Example on configuring data retention from openAI docs: https://platform.openai.com/docs/guides/migrate-to-responses#4-decide-when-to-use-statefulness

AI Bridge could be configurable to set those storage options. Possible options
* reject requests that would result in data being stored in provider API
* override `store` field value for all requests + add ["reasoning.encrypted_content"] to the [include field](https://platform.openai.com/docs/api-reference/responses/create#responses_create-include))

It seems that Anthropic doesn't support configuring data retention in requests (https://privacy.claude.com/en/articles/7996866-how-long-do-you-store-my-organization-s-data https://platform.claude.com/docs/en/api/messages/create).
Zero data retention requires special agreement: https://privacy.claude.com/en/articles/8956058-i-have-a-zero-data-retention-agreement-with-anthropic-what-products-does-it-apply-to
Maybe more research is needed to about storing Anthropic messages.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.