Azure / Azure/azure-sdk-for-python

Purview Entity.get_by_ids batch size limit likely not documented?

Open
#39,935 1 comment 0 reactions 0 assignees View on GitHub
customer-reported needs-team-attention Purview question Service Attention
Dominant language
Python
Stars
5.6k
Forks
3.4k
Avg merge
1d 21h
Merged PRs (30d)
193

Description

- **Package Name**: azure-purview-datamap
- **Package Version**: 1.0.0b1
- **Operating System**: Windows
- **Python Version**: 3.11

**Describe the bug**
I'm running into some issues with the `DataMapClient.entity.get_by_ids(guid=guid_list)` method, which fails when the passed list of guids is large. So far, by testing manually I get a response when I pass 193 or less guids in that list. If I send 194 or more guids in that call I get a `JsonDecodeError` from the API. While it makes sense there are limits, 194 seems like an odd number and I've never seen anything like that in the docs. Also, the JsonDecodeError seems hard to decipher, since I'm not actually getting HTTP codes from the API call.

**To Reproduce**
Steps to reproduce the behavior:
1. fetch a list of more than 194 guids from a Purview instance
2. call DataMapClient.entity.get_by_ids(guid=guid_list)

**Expected behavior**
I'd like to know if there's anyplace in the docs where this is mentioned, and if so, get a clear HTTP response of why the call is failing

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.