关于hive表自动补全日期
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
有一些数据从MySql进行转存到Hive上面,然后现在是每天在Hive上执行一次建表语句,为固定 xxdate这种形式,后面的日期通过shell已经进行获取,现在是每天都能创建一个hive表。但从MySql的数据插入到Hive上,怎么根据当前月日将数据插入到对应的Hive表,比如今天是 1014,怎么插入到 xx1014这个hive表当中。我查看看关于hdfswriter里面的json配置表,目前还没有看到,里面的是较为简单的使用,不知道有哪位了解的,可以帮我解答一下吗
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names MySQL, Hive, shell-generated dates, and hdfswriter JSON configuration but no specific file or test. Start by locating the hdfswriter configuration and the MySQL-to-Hive DataX entry point; determine whether date-suffixed table selection is supported, and define completion as a documented configuration or implementation that targets the current date's table.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, mysql, shell
- Domain
- data-engineering, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100