Azure / Azure/azure-cli

az datafactory pipeline list fails with parse error for large number of pipelines

Open
#27,563 5 comments 0 reactions 2 assignees Claimed by @evelyn-ys View on GitHub
act-codegen-extensibility-squad Auto-Assign Auto-Resolve bug customer-reported Data Factory Service Attention
Dominant language
Python
Stars
4.6k
Forks
3.5k
Avg merge
3d 2h
Merged PRs (30d)
60

Description

### Describe the bug

When using the commands az datafactory pipeline list to return a list of the pipelines associated with an Azure Data Factory the command will return a JSON parser error when there are a large number of pipelines associated with the data factory.

### Related command

az datafactory pipeline list

### Errors

InnerException : False
Exception : Microsoft.Rest.SerializationException: Unable to deserialize the response.
---> Newtonsoft.Json.JsonReaderException: Error reading boolean. Unexpected token: StartObject. Path 'enablePartitionDiscovery', line 11090, position 63.
at Newtonsoft.Json.JsonReader.ReadAsBoolean()
at Newtonsoft.Json.JsonReader.ReadForType(JsonContract contract, Boolean hasConverter)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReader reader, Type objectType,

### Issue script & Debug output

az datafactory pipeline list

### Expected behavior

JSON response

### Environment Summary

azure-cli: 2.52.0
azure-cli-core: 2.52.0
azure-cli-telemetry: 1.1.0

extensions:
account: 0.2.5
aks-preview: 0.5.156
azure-devops: 0.26.0
containerapp: 0.3.39
datafactory: 0.7.0
devcenter: 2.0.0
resource-graph: 2.1.0

### Additional context

This appears to be because the command does not properly handle the situation where the underlying REST API response is paginated. To test this you can use az rest and note that the API returns only part of the data and indicated that there is more to follow.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.