[Feature Request]: Allow configuring the amount of sharding in DataFrame IOs
Open
dataframe
dsl
new feature
P2
python
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
### What would you like to happen?
https://lists.apache.org/thread/9m8mpv9ljdq2h52fdmytvr6ot6sfybbp
> Is there any way to control the amount of sharing on the to_parquet call? (I tried adding n_shards = N, but seems to have no effect)
### Issue Priority
Priority: 2
### Issue Component
Component: dsl-dataframe
Contributor guide
Assessment
This issue has not been assessed yet.