danilop / danilop/multimodal-chat

AccessDenied for claude and meta models. I was granted access earlier today. waiting a few hours. still an issue

Open
#7 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
132
Forks
19
PR merge metrics
No merged PRs in 30d

Description

Claude
```
{
'modelId': 'anthropic.claude-3-5-sonnet-20240620-v1:0',
'messages': [
{
'role': 'user',
'content': [{'text': 'Find an image with a dog.'}]
}
],
'inferenceConfig': {'maxTokens': 4096, 'temperature': 0.5}
}
Thinking...
An error occurred (AccessDeniedException) when calling the Converse
operation: You don't have access to the model with the specified model ID.
Error: An error occurred (AccessDeniedException) when calling the Converse
operation: You don't have access to the model with the specified model ID.
Traceback (most recent call last):
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/queueing.py", line 536, in process_events
response = await route_utils.call_process_api(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/route_utils.py", line 321, in call_process_api
output = await app.get_blocks().process_api(
```

And llama3-8b
```
{
'modelId': 'meta.llama3-1-8b-instruct-v1:0',
'messages': [
{
'role': 'user',
'content': [{'text': 'Find an image with a dog.'}]
}
],
'inferenceConfig': {'maxTokens': 4096, 'temperature': 0.5}
}
Thinking...
An error occurred (AccessDeniedException) when calling the Converse
operation: You don't have access to the model with the specified model ID.
Error: An error occurred (AccessDeniedException) when calling the Converse
operation: You don't have access to the model with the specified model ID.
Traceback (most recent call last):
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/queueing.py", line 536, in process_events
response = await route_utils.call_process_api(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/route_utils.py", line 321, in call_process_api
output = await app.get_blocks().process_api(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/blocks.py", line 1935, in process_api
result = await self.call_function(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/blocks.py", line 1532, in call_function
prediction = await utils.async_iteration(iterator)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/utils.py", line 671, in async_iteration
return await iterator.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/utils.py", line 776, in asyncgen_wrapper
response = await iterator.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/chat_interface.py", line 653, in _stream_fn
first_response = await async_iteration(generator)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/utils.py", line 671, in async_iteration
return await iterator.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/utils.py", line 664, in __anext__
return await anyio.to_thread.run_sync(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/anyio/to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
return await future
^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 859, in run
result = context.run(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/miniconda3/lib/python3.12/site-packages/gradio/utils.py", line 647, in run_sync_iterator_async
return next(iterator)
^^^^^^^^^^^^^^
File "/Users/admin/dev/multimodal-chat/multimodal_chat.py", line 1404, in chat_function
response = run_loop(messages, system_prompt, temperature, state)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/admin/dev/multimodal-chat/multimodal_chat.py", line 1355, in run_loop
response_message = response['output']['message']
~~~~~~~~^^^^^^^^^^
TypeError: string indices must be integers, not 'str'
```

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with multimodal_chat.py, especially run_loop around line 1355 and chat_function around line 1404, and inspect how the Bedrock model IDs are selected and errors returned. Reproduce the Converse calls for the Claude and Meta model IDs; done means authorized requests work and an access failure does not trigger the reported TypeError.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
ai, backend, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.