isar / isar/hive

After "insert overwrite" the data, the old data is not delete!

Open
#272 1 comment 0 reactions 0 assignees View on GitHub
question
Dominant language
Dart
Stars
4.4k
Forks
449
PR merge metrics
No merged PRs in 30d

Description

**Question**
After the hive repository overwrites the inserted data, the data that should be overwritten is not deleted.What's going on here?

**Code sample**
explain:
temp_topic table: There are two fields, 260 rows of data
temp_topic2 table: lik temp_topic table

The SQL is executed in the following order:
`
create table temp_topic2 like temp_topic stored as textfile;
insert overwrite table temp_topic2 select * from temp_topic;
select count(*) from temp_topic2; ==> result:260 √

insert overwrite table temp_topic2 select "test data" ,4;
select count(*) from temp_topic2; ==> result:1 √

hdfs dfs -ls /XXX/test.db/temp_topic2
/XXX/test.db/temp_topic2/base_0000001 [This folder should be deleted. But he didn't]
/XXX/test.db/temp_topic2/base_0000002

hdfs dfs -rm /XXX/test.db/temp_topic2/base_0000002

select count(*) as a from temp_topic2; [Prevent SQL from caching results] ==> result: 260 ×

There comes the problem : The data in base_000001 as the temp_topic table was not deleted.
Maybe there's a parameter here that causes. But I don't know! Please tell me
`

**Version**
- Platform:HDP3.1.0
- Hive version: [3.1.0]

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.