alibaba / alibaba/DataX

关于hive表自动补全日期

Open
#473 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

有一些数据从MySql进行转存到Hive上面,然后现在是每天在Hive上执行一次建表语句,为固定 xxdate这种形式,后面的日期通过shell已经进行获取,现在是每天都能创建一个hive表。但从MySql的数据插入到Hive上,怎么根据当前月日将数据插入到对应的Hive表,比如今天是 1014,怎么插入到 xx1014这个hive表当中。我查看看关于hdfswriter里面的json配置表,目前还没有看到,里面的是较为简单的使用,不知道有哪位了解的,可以帮我解答一下吗

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names MySQL, Hive, shell-generated dates, and hdfswriter JSON configuration but no specific file or test. Start by locating the hdfswriter configuration and the MySQL-to-Hive DataX entry point; determine whether date-suffixed table selection is supported, and define completion as a documented configuration or implementation that targets the current date's table.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql, shell
Domain
data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.