microsoft-foundry / microsoft-foundry/foundry-samples

[python] new agent stream error

Open
#391 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Bicep
Stars
445
Forks
494
Avg merge
11h 35m
Merged PRs (30d)
38

Description

hi!
trying to migrate to new version foundry agent. (docs not clear)
im using as an example the one given in this repo.

responses.create(..) works fine, but when trying to stream responses ,i cant get it to work

this is my code:

openai_client = project_client.get_openai_client()
agent_model= get_agent_model(agent_name) #this just return the model config in foundry
print(agent_model)

# Optional Step: Create a conversation to use with the agent
conversation = openai_client.conversations.create()
print(f"Created conversation (id: {conversation.id})")

# Chat with the agent to answer questions
with openai_client.responses.stream(
    conversation=conversation.id,
    #model=agent_model,
    extra_body={"agent": {"name": agent_name, "type": "agent_reference"}},
    input="hi!",
) as stream:
    for event in stream:
        if event.type == "response.output_text.delta":    
            print(event.delta, end="", flush=True)

versions:
azure-ai-agents 1.1.0
azure-ai-projects 2.0.0b2
azure-core 1.35.1

console error:
Created conversation (id: conv_23ee7a807b7307ce00nGBsefUEqRE448CvhIyABlMEqNJOPqoQ)
Traceback (most recent call last):
File "c:\Users\Alejandro Piccardo\Desktop\cambios quantis\agente\BackendFastapi-Agent\dev\scripts\NewApi.py", line 36, in
with openai_client.responses.stream(
File "C:\Users\Alejandro Piccardo\Desktop\cambios quantis\agente\BackendFastapi-Agent\env\lib\site-packages\openai\resources\responses\responses.py", line 1005, in stream
raise ValueError("model must be provided when creating a new response")
ValueError: model must be provided when creating a new response

so the first thing i did was:
uncomment the model line and this error happend:

console error:
Created conversation (id: conv_24f10f51dc2a61b900s2HxndrRWcRPtFYEZOmp3iyODsSbiSgE)
Traceback (most recent call last):
File "c:\Users\Alejandro Piccardo\Desktop\cambios quantis\agente\BackendFastapi-Agent\dev\scripts\NewApi.py", line 36, in
with openai_client.responses.stream(
File "C:\Users\Alejandro Piccardo\Desktop\cambios quantis\agente\BackendFastapi-Agent\env\lib\site-packages\openai\lib\streaming\responses_responses.py", line 111, in enter
raw_stream = self.__api_request()
File "C:\Users\Alejandro Piccardo\Desktop\cambios quantis\agente\BackendFastapi-Agent\env\lib\site-packages\openai\resources\responses\responses.py", line 828, in create
return self._post(
File "C:\Users\Alejandro Piccardo\Desktop\cambios quantis\agente\BackendFastapi-Agent\env\lib\site-packages\openai_base_client.py", line 1259, in post
return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
File "C:\Users\Alejandro Piccardo\Desktop\cambios quantis\agente\BackendFastapi-Agent\env\lib\site-packages\openai_base_client.py", line 1047, in request
raise self._make_status_error_from_response(err.response) from None
openai.BadRequestError: Error code: 400 - {'error': {'code': 'invalid_payload', 'message': 'Not allowed when agent is specified.', 'param': 'model', 'type': 'invalid_request_error', 'details': [], 'additionalInfo': {'request_id': '7153967e656a11df001f063de6275551'}}}

what im doing wrong? or streams are not implemented correctly??? can you guys provide me with an example response.stream(..)

thanks.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the supplied Python streaming example and the listed azure-ai-agents 1.1.0 and azure-ai-projects 2.0.0b2 versions, then compare the two reported responses calls and their errors. Reproduce the model-required and agent/model-conflict cases. Done means the sample documentation explains the compatible streaming request and includes a working response.stream example.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, python
Domain
api, cloud, documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.