elastic / elastic/apm-agent-nodejs
Support for Azure OpenAI
Open
- Dominant language
- JavaScript
- Stars
- 594
- Forks
- 244
- Avg merge
- 1d 8h
- Merged PRs (30d)
- 16
Description
The APM agent should have support for auto-instrumentation of [Azure OpenAI library](https://www.npmjs.com/package/@azure/openai) in order to better support applications that interacts with this LLM.
What we need to collect that we don’t collect OOTB today :
- User prompt (string)
- LLM response (string)
- Token count (number)
**Stretch goal**
It is also possible to interact with Azure OpenAI using the [OpenAI library](https://www.npmjs.com/package/openai). Preferably we support this library as well.
**Related**
- https://github.com/elastic/observability-docs/issues/3961
- https://github.com/elastic/apm-agent-python/issues/2064
Contributor guide
Assessment
This issue has not been assessed yet.