Azure-Samples / Azure-Samples/ai-rag-chat-evaluator

mismatched_organization error

Open
#76 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
335
Forks
113
Avg merge
3d 15h
Merged PRs (30d)
1

Description

when comparing local llama2 model with GPT4, got error:

ERROR Failed to send a test chat completion to the GPT deployment due to error: evaluate.py:110
Error code: 401 - {'error': {'message': 'OpenAI-Organization header should match organization for API key', 'type': 'invalid_request_error',
'param': None, 'code': 'mismatched_organization'}

Contributor guide

Open the contributing guide

Research direction

Start at evaluate.py:110 and reproduce the GPT deployment test while comparing the local llama2 model with GPT4. Trace the organization configuration involved in the request and verify that the comparison no longer returns the mismatched_organization 401 error; document any required configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.