elastic / elastic/elastic-evals-sdk-python

Experiment results URL points to nonexistent Kibana /runs/ route

Open
#64 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2
Forks
0
Avg merge
1d 10h
Merged PRs (30d)
18

Description

At SDK commit `f86f4a013778c08ccbeb64195464f3378f13bbd5`, `log_results_url()` prints:

```text
{KIBANA_URL}/app/management/ai/evals/runs/{run_id}
```

Kibana 9.5.3 has no `/runs/:runId` evals route. Its detail route is `/experiments/:experimentId`. During a successful 30-example run, the SDK printed the `/runs/` link above; opening `/experiments/{RanExperiment.id}` instead showed all per-example results and evaluator statistics.

Sources:

- [SDK URL builder](https://github.com/elastic/elastic-evals-sdk-python/blob/f86f4a013778c08ccbeb64195464f3378f13bbd5/src/elastic_evals/utils/logging.py#L95)
- [Kibana 9.5.3 routes](https://github.com/elastic/kibana/blob/v9.5.3/x-pack/platform/plugins/shared/evals/public/application.tsx)

This is Python-SDK-maturity/UX: successful execution should return a usable experiment URL (ideally on `RanExperiment`) and print that same URL. Preserve any configured base/space path and strip userinfo credentials. Be explicit about execution grouping: the SDK's run ID and `RanExperiment.id` are different IDs, and simply replacing `/runs/` with `/experiments/` while retaining `run_id` is not sufficient without the appropriate execution query parameter.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with src/elastic_evals/utils/logging.py at the SDK URL builder and inspect how RanExperiment and the execution IDs are available. Compare the builder with Kibana's application.tsx routes and verify the configured base/space path and credential handling. Done means successful execution returns and prints a usable /experiments/{experimentId} URL with the appropriate execution grouping.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
developer-experience
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
68/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.