Azure / Azure/azure-sdk-for-python

azure-ai-* tracing: support non-function tools

Open
#39,995 0 comments 1 reaction 1 assignee Claimed by @M-Hietala View on GitHub
AI Projects Client feature-request
Dominant language
Python
Stars
5.6k
Forks
3.4k
Avg merge
1d 21h
Merged PRs (30d)
193

Description

We don't record inputs and outputs for any tool call that's not function (code_interpreter, azure_ai_search, file_search, etc).

So traces contains something like this

```json
{"tool_calls": [{"id": "call_bA08K28rVvFhP99gqq1EHkh9", "type": "code_interpreter", "function": null}]}
```

when the actual response looks like

```json
{"tool_calls": [{"id": "call_IQFW4HNEzfoRhKHw1htd7feq", "type": "code_interpreter", "code_interpreter": {"input": "# Reversing the user-provided string\r\nuser_input = \"just some random input\"\r\nreversed_string = user_input[::-1]\r\nreversed_string", "outputs": []}}]}
```

---
We should capture the details for arbitrary tools when content recording is enabled. We might want to define a format for a few tools (e.g. azure search) if/when it's formalized in the typespec. Currently it's just `dict`.

https://github.com/Azure/azure-sdk-for-python/blob/08e7c8adb4434aa76eb4a439b644aed7fe41c0f4/sdk/ai/azure-ai-projects/azure/ai/projects/models/_models.py#L4437

//cc @jhakulin @M-Hietala

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.