googleapis / googleapis/google-cloud-go
vertexai: Backport cachedContentTokenCount
Open
api: vertex-ai
type: feature request
- Dominant language
- Go
- Stars
- 4.5k
- Forks
- 1.6k
- Avg merge
- 1d 13h
- Merged PRs (30d)
- 109
Description
Unable to pull [cached token counts](https://cloud.google.com/vertex-ai/docs/reference/rest/v1beta1/GenerateContentResponse#UsageMetadata
) into our telemetry data without this metadata key available in the SDK
## Describe the solution you'd like
Can this value be backported into the Go SDK?
## Describe alternatives you've considered
We are aware of the GenAI SDK but due to a number of factors, including plans to build our own http API client we are unable to migrate to this SDK.
## Additional context
https://pkg.go.dev/cloud.google.com/go/vertexai@v0.15.0
Contributor guide
Assessment
This issue has not been assessed yet.