Azure / Azure/azure-sdk-for-python
azure-ai-* tracing: support non-function tools
- Dominant language
- Python
- Stars
- 5.6k
- Forks
- 3.4k
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 193
Description
We don't record inputs and outputs for any tool call that's not function (code_interpreter, azure_ai_search, file_search, etc).
So traces contains something like this
```json
{"tool_calls": [{"id": "call_bA08K28rVvFhP99gqq1EHkh9", "type": "code_interpreter", "function": null}]}
```
when the actual response looks like
```json
{"tool_calls": [{"id": "call_IQFW4HNEzfoRhKHw1htd7feq", "type": "code_interpreter", "code_interpreter": {"input": "# Reversing the user-provided string\r\nuser_input = \"just some random input\"\r\nreversed_string = user_input[::-1]\r\nreversed_string", "outputs": []}}]}
```
---
We should capture the details for arbitrary tools when content recording is enabled. We might want to define a format for a few tools (e.g. azure search) if/when it's formalized in the typespec. Currently it's just `dict`.
https://github.com/Azure/azure-sdk-for-python/blob/08e7c8adb4434aa76eb4a439b644aed7fe41c0f4/sdk/ai/azure-ai-projects/azure/ai/projects/models/_models.py#L4437
//cc @jhakulin @M-Hietala
Contributor guide
Assessment
This issue has not been assessed yet.