Azure / Azure/azure-sdk-for-python

Token usage and genai calls not seen in ai foundary tracing for AI Agents

Open
#40,176 3 comments 0 reactions 1 assignee Claimed by @M-Hietala View on GitHub
Client customer-reported Monitor - Exporter needs-team-attention question Service Attention
Dominant language
Python
Stars
5.6k
Forks
3.4k
Avg merge
1d 21h
Merged PRs (30d)
193

Description

I configured azure monitor open telemetry to an ai agent application and configured `AZURE_TRACING_GEN_AI_CONTENT_RECORDING_ENABLED=true` in my environment variables but i still can't see the LLM calls in AI foundary tracing. While the same is much cleaner when I integrate the application insights with semantic kernel chatcompletion agent and setting `SEMANTICKERNEL_EXPERIMENTAL_GENAI_ENABLE_OTEL_DIAGNOSTICS_SENSITIVE=true`

Sample output with SK chatcompletion agent:

![Image](https://github.com/user-attachments/assets/ecf4faac-6272-4ed8-b426-79a965473631)

Sample output with AI agent

![Image](https://github.com/user-attachments/assets/a5b8a2dd-2dca-429c-8a36-f585c1a97eb9)

Keeping or removing `AZURE_TRACING_GEN_AI_CONTENT_RECORDING_ENABLED=true` in .env file doesn't change the output.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.