apache / apache/drill

For a table created in Kudu through Apache Impala - Not able to run "select * from <some table>" using Apache Drill

Open
#2,323 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
2k
Forks
990
Avg merge
1d 8h
Merged PRs (30d)
5

Description

**Describe the bug**
Created a table in Kudu through Apache Impala (table is given below) and inserted several records. Then I connected to Apache Kudu through Apache Drill, and able to list tables fine. But when I have to fetch data from the table "impala::default.customer" below, I get below error when the primary key if of "BIGINT" data type, and I don't error when it's any other Data Type for the Primary Key (details are discussed on Stackoverflow.com link below).

apache drill (kudu)> select * from impala::default.customer;

Error: INTERNAL_ERROR ERROR: org.apache.kudu.client.NonRecoverableException: Invalid scan stop key: Error decoding composite key component 'id': key too short: Fragment: 1:0 [Error Id: 244fbbc4-42ea-40cf-9cc0-ee30caec7eca on ubuntu-VirtualBox:31010] (state=,code=0) ".

Table ==>
CREATE TABLE customer(
id BIGINT,
first_name STRING,
last_name STRING,
age INT,
customer_id STRING,
PRIMARY KEY(id))
PARTITION BY HASH PARTITIONS 4
STORED AS KUDU;

**To Reproduce**
Steps to reproduce the behavior:
Followed these links to setup Single node cluster on VirtualBox (Ubuntu 20.03)

Apache Kudu QuickStart
First setup Kudu - https://kudu.apache.org/docs/quickstart.html
Then setup Impala - https://github.com/apache/kudu/tree/master/examples/quickstart/impala

1. Create a table in Kudu through Impala (table definition as above) (assume Kudu, Impala are setup as mentioned on the above links). Used latest version of Apache Drill, and ran "drill-embedded" script.
2. Insert some data in this table
3. Connect Drill to Kudu and try to browse the table created above, and I get error
apache drill (kudu)> select * from impala::default.customer;

Error: INTERNAL_ERROR ERROR: org.apache.kudu.client.NonRecoverableException: Invalid scan stop key: Error decoding composite key component 'id': key too short: Fragment: 1:0 [Error Id: 244fbbc4-42ea-40cf-9cc0-ee30caec7eca on ubuntu-VirtualBox:31010] (state=,code=0) ".

4. Please notice that I saw this error only when the Primary Key was of BIGINT type, it was fine for other data types.

**Expected behavior**
Should be able to browse the data just fine

**Desktop (please complete the following information):**
- OS: VirtualBox, Ubuntu 20.03

**Additional context**
This issue has been discussed "cgivre" with at Stackoverflow.com,
https://stackoverflow.com/questions/69400913/apache-drill-and-apache-kudu-not-able-to-run-select-from-some-table-usin

Thanks,
Vikas Kumar

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.