alibaba / alibaba/DataX

用 hbase11xsqlwriter 向phoenix写数据的问题

Open
#163 4 comments 2 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

环境是 phoenix5.0,hbase是2.0,hadoop是3.0
对于 TABLE_SCHEM 的处理有问题。
举个例子,phoenix新建表 SCHEM.MYTABLE,表在hbase中是 SCHEM:MYTABLE。
所以问题来了,表名配置成 SCHEM:MYTABLE,则可以通过校验,但无法写数据,因为phoenix不认识这个表;如果配置成 SCHEM.MYTABLE,无法通过校验,因为hbase找不到表。
建议在配置文件中加上 schem 的配置,
或者配置为 SCHEM:MYTABLE,然后 HbaseSQLWriterTask 的 173 行,加上处理代码,
tableName = tableName.replace(":", ".");
让表名变成 phoenix 可以识别的表名。

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with HbaseSQLWriterTask around line 173 and trace how TABLE_SCHEM and table names are validated before writing. Reproduce the issue with Phoenix 5.0, HBase 2.0, and Hadoop 3.0 using SCHEM.MYTABLE and SCHEM:MYTABLE; done means validation and writes both work for the Phoenix table name.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.