For a table created in Kudu through Apache Impala - Not able to run "select * from <some table>" using Apache Drill
- Dominant language
- Java
- Stars
- 2k
- Forks
- 990
- Avg merge
- 1d 8h
- Merged PRs (30d)
- 5
Description
**Describe the bug**
Created a table in Kudu through Apache Impala (table is given below) and inserted several records. Then I connected to Apache Kudu through Apache Drill, and able to list tables fine. But when I have to fetch data from the table "impala::default.customer" below, I get below error when the primary key if of "BIGINT" data type, and I don't error when it's any other Data Type for the Primary Key (details are discussed on Stackoverflow.com link below).
apache drill (kudu)> select * from impala::default.customer;
Error: INTERNAL_ERROR ERROR: org.apache.kudu.client.NonRecoverableException: Invalid scan stop key: Error decoding composite key component 'id': key too short: Fragment: 1:0 [Error Id: 244fbbc4-42ea-40cf-9cc0-ee30caec7eca on ubuntu-VirtualBox:31010] (state=,code=0) ".
Table ==>
CREATE TABLE customer(
id BIGINT,
first_name STRING,
last_name STRING,
age INT,
customer_id STRING,
PRIMARY KEY(id))
PARTITION BY HASH PARTITIONS 4
STORED AS KUDU;
**To Reproduce**
Steps to reproduce the behavior:
Followed these links to setup Single node cluster on VirtualBox (Ubuntu 20.03)
Apache Kudu QuickStart
First setup Kudu - https://kudu.apache.org/docs/quickstart.html
Then setup Impala - https://github.com/apache/kudu/tree/master/examples/quickstart/impala
1. Create a table in Kudu through Impala (table definition as above) (assume Kudu, Impala are setup as mentioned on the above links). Used latest version of Apache Drill, and ran "drill-embedded" script.
2. Insert some data in this table
3. Connect Drill to Kudu and try to browse the table created above, and I get error
apache drill (kudu)> select * from impala::default.customer;
Error: INTERNAL_ERROR ERROR: org.apache.kudu.client.NonRecoverableException: Invalid scan stop key: Error decoding composite key component 'id': key too short: Fragment: 1:0 [Error Id: 244fbbc4-42ea-40cf-9cc0-ee30caec7eca on ubuntu-VirtualBox:31010] (state=,code=0) ".
4. Please notice that I saw this error only when the Primary Key was of BIGINT type, it was fine for other data types.
**Expected behavior**
Should be able to browse the data just fine
**Desktop (please complete the following information):**
- OS: VirtualBox, Ubuntu 20.03
**Additional context**
This issue has been discussed "cgivre" with at Stackoverflow.com,
https://stackoverflow.com/questions/69400913/apache-drill-and-apache-kudu-not-able-to-run-select-from-some-table-usin
Thanks,
Vikas Kumar
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.