How to specify queue when import data to Hive
- Dominant language
- Python
- Stars
- 1k
- Forks
- 131
- PR merge metrics
- No merged PRs in 30d
Description
When I want to import a pandas dataframe to hive, I receive an error:
```
...org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1560772252855_0373 to YARN : Application application_1560772252855_0373 submitted by user hdfs to unknown queue: default:28:27'...
```
I want to specify the yarn queue name that hive use but not use the "default" queue, but I have no idea how to do that.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing the pandas DataFrame import path into Hive and identifying where the YARN submission queue is configured. The issue names no files or tests; done would mean the import can use a specified non-default queue instead of failing against the default queue.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- pandas, python
- Domain
- data-engineering, databases, distributed-systems
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100