How do we configure datax TaskGroup to make it running concurrently?
Open
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
I use datax extracting data records from many tables to one hive table. I want to make it work in many threads. How do we configure datax configuration file?
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with DataX's TaskGroup configuration and the configuration file used for extracting multiple tables into Hive. Determine how concurrency is configured and what thread setting applies, then document a working configuration and verify that the extractions run concurrently.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100