Azure / Azure/azure-sdk-for-python

[azure-ai-evaluation] studio_url returned by evaluate() only works for old Foundry experience, not new Foundry

Open
#45,234 1 comment 0 reactions 0 assignees View on GitHub
Evaluation Service Attention
Dominant language
Python
Stars
5.6k
Forks
3.4k
Avg merge
1d 21h
Merged PRs (30d)
193

Description

## Description

When using `azure-ai-evaluation`'s `evaluate()` function with an `azure_ai_project` parameter, the `studio_url` in the result dictionary points to the old Azure AI Foundry (AI Studio) experience. This URL does not work for users who have the new Foundry experience toggled on.

## Current behavior

The SDK generates URLs in this format (returned in AiStudioEvaluationUri from upload API):

```
https://ai.azure.com/resource/build/evaluation/{evaluation_id}?wsid=/subscriptions/{subscription_id}/resourceGroups/{resource_group}/providers/Microsoft.CognitiveServices/accounts/{account}/projects/{project}&tid={tenant_id}
```

## Expected behavior

For users who have the new Foundry experience enabled, the URL should be different, something like?

```
https://ai.azure.com/nextgen/r/{encoded_project_id}/Build/evaluations/list
```

Or ideally, the URL should redirect to the correct experience automatically regardless of which Foundry UX the user has enabled.

## Steps to reproduce

1. Run `evaluate()` from `azure-ai-evaluation` with `azure_ai_project` configured
2. Check the `studio_url` in the returned result
3. Open the URL in a browser with the new Foundry experience toggled on. See that the URL just redirects back to Foundry home. Navigate to Evaluations tab and see NO evaluation runs.

Image

5. Toggle off New Foundry, navigate to URL, and successfully see evaluations:

Image

So there are two issues - one that the new foundry doesnt show evaluations, but second issue that the studio_url should direct users to the right place in new foundry if they're using it.

## Package version

`azure-ai-evaluation` 1.15.0

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.