apache / apache/iotdb

[Bug] a lot of files in unsequence folder after old data migration

Open
#11,660 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.4k
Forks
1.2k
Avg merge
1d 23h
Merged PRs (30d)
115

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/iotdb/issues) and found nothing similar.

### Version

Centos 7.4
0.13.4

### Describe the bug and provide the minimal reproduce step

After migrating data from another iotdb instance to the new one, there are a lot of files in unsequence folder, and the total file size is about 11G, meanwhile, the query performance is very poor for some query sql, which takes about 80+ seconds to finish the query.

### What did you expect to see?

the file size in unsequence folder decrease after run MERGE command in CLI and the query cost should be under 1s.

### What did you see instead?

nothing happen after running the MERGE command.

### Anything else?

_No response_

### Are you willing to submit a PR?

- [ ] I'm willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the migration from the other IoTDB instance, then run MERGE in the CLI while monitoring the unsequence folder and query timing. Done means the unsequence files decrease and the affected queries complete in under one second.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.