Azure-Samples / Azure-Samples/rag-data-openai-python-promptflow

evaluate.py: missing pip package promptflow.azure

Open
#34 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
290
Forks
152
PR merge metrics
No merged PRs in 30d

Description

> Please provide us with the following information:
> ---------------------------------------------------------------

### This issue is for a: (mark with an `x`)
```
- [x] bug report -> please search issues before submitting
- [ ] feature request
- [x] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)
```

### Minimal steps to reproduce
> follow instructions https://learn.microsoft.com/en-us/azure/ai-studio/tutorials/copilot-sdk-evaluate-deploy#run-the-evaluation-script
pip install is missing package promptflow.azure
this leads to an exception when running python evaluate.py

The documentation need to be updated:
pip install promptflow-evals
pip install promptflow.azure

### Any log messages given by the failure
>(.venv) PS C:\work\Azure-Samples\rag-data-openai-python-promptflow\tutorial> python .\evaluate.py
Traceback (most recent call last):
File "C:\Users\...\.venv\Lib\site-packages\promptflow\_sdk\_tracing.py", line 107, in validate
from promptflow.azure._utils._tracing import validate_trace_destination
ModuleNotFoundError: No module named 'promptflow.azure'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\work\Azure-Samples\rag-data-openai-python-promptflow\tutorial\evaluate.py", line 80, in
result, tabular_result = run_evaluation(
^^^^^^^^^^^^^^^
File "C:\work\Azure-Samples\rag-data-openai-python-promptflow\tutorial\evaluate.py", line 49, in run_evaluation
result = evaluate(
^^^^^^^^^
File "C:\Users\...\.venv\Lib\site-packages\promptflow\evals\evaluate\_telemetry\__init__.py", line 115, in wrapper
pf_client = PFClient(
^^^^^^^^^

### Expected/desired behavior
> pip install promptflow.azure

### OS and Version?
> Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)

### Versions
>

### Mention any other details that might be useful

> ---------------------------------------------------------------
> Thanks! We'll be in touch soon.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked Copilot SDK evaluation tutorial and compare its installation commands with tutorial/evaluate.py, especially the imports and call to run_evaluation. Update the documented setup so the required package is installed, then follow the tutorial and run python evaluate.py to confirm the missing promptflow.azure error is resolved.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, python
Domain
documentation
Issue type
Documentation
Difficulty
1/5
Estimated time
Under an hour
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.