Permission error while reading HDFS file
Open
- Dominant language
- Python
- Stars
- 148
- Forks
- 93
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
I have dask-gateway set up on our hadoop cluster with yarn.
Without establishing a connection to the gateway, a simple csv read from hdfs works perfectly.
```
df = dask.dataframe.read_csv('webhdfs://namnode.example.com/path/tocsv.csv', storage_options={'kerberos':True})
df.tail()
```
However as soon as I establish the gateway cluster connection, this fails with **Exception: PermissionError()** in the worker log.
A simple print(df) is able to read the dataframe structure correctly.
I'd appreciate any inputs on what I'm missing!
Contributor guide
Assessment
This issue has not been assessed yet.