alibaba / alibaba/x-deeplearning
想问下当前xdl reader 是否支持hdfs压缩格式的数据读取
Open
- Dominant language
- PureBasic
- Stars
- 4.3k
- Forks
- 1k
- PR merge metrics
- No merged PRs in 30d
Description
想问下当前 xdl 在运行分布式时，是否支持读取 hdfs 上压缩格式的数据，如 deflate 格式。
如果支持，应该如何配置;
若未支持，想问下是否有支持的计划
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by checking the xdl reader's existing distributed-input configuration and its handling of compressed data on HDFS, focusing on the deflate format mentioned in the issue. Done would mean confirming whether deflate is supported and documenting the required configuration, or defining the support gap and implementation scope.
Written by the indexing model from the issue text.
Assessment
- Domain
- data-engineering, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100