apache / apache/drill

dataPath expression for http-storage-plugin

Open
#2,792 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
2k
Forks
990
Avg merge
1d 8h
Merged PRs (30d)
5

Description

Hello Guys,
Could you please help me to create the correct “[dataPath](https://drill.apache.org/docs/http-storage-plugin/)” for Drill http-storage-plugin?
I have a JSON response like:
```
{
"1": {
"id": 1,
"employeeId": 1,
"firstName": "John",
"lastName": "Doe",
"email": "john.doe@bamboohr.com",
"status": "enabled",
"lastLogin": "2011-03-19T10:16:00+00:00"
},
"2": {
"id": 2,
"firstName": "Jane",
"lastName": "Doe",
"email": "jane.doe@bamboohr.com",
"status": "enabled",
"lastLogin": "2011-08-29T11:17:43+00:00"
}
}
```
https://documentation.bamboohr.com/reference/get-a-list-of-users-1
And I need that only field id, employeeId, firstName, lastName, email, status, lastLogin returns.

I have tried to use the following configuration, but it doesn’t return any data.
`"dataPath": "$.*.{id, employeeId, firstName, lastName, email, status, lastLogin}"`
Can I use some expressions to return only required fields?

Contributor guide

No contributing guide indexed for this repository

Research direction

Read the linked HTTP storage plugin dataPath documentation and compare its supported expression syntax with the sample JSON and attempted configuration. Verify the result against the requested fields; done means a documented expression returns records containing id, employeeId, firstName, lastName, email, status, and lastLogin.

Written by the indexing model from the issue text.

Assessment

Tech stack
json
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.