In HDFS, how to read csv file in which columns contain key name?
Open
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
The csv file is stored in HDFS. The content is as below for example. The column amount may be different row by row.
```
key1=val11,key2=val21
key1=val12,key3=val32,key4=val42
```
Contributor guide
No contributing guide indexed for this repository
Research direction
No files, tests, or entry points are mentioned. Start by locating DataX's existing HDFS and CSV reader documentation or plugin entry points; the issue would need a defined reader behavior and tests for rows with differing key sets before it is complete.
Written by the indexing model from the issue text.
Assessment
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100