apache / apache/iotdb

sql 执行报错

Open
#6,346 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.4k
Forks
1.2k
Avg merge
1d 23h
Merged PRs (30d)
115

Description

**Describe the bug**

我们对iotdb时间序列的类型做过修改 例:删除double类型的root.ln_1.ph,再新增text类型的root.ln_1.ph
我们对iotdb的分组加了TTL

iotdbserver运行一段时间后异常停止,重启后执行查询sql报错

**To Reproduce**
Steps to reproduce the behavior:
1. iotdbserver运行一段时间异常退出
2. 调用启动脚本启动iotdbserver
3. 登录iotdb命令窗口,执行查询sql
4. 报截图错误

**Expected behavior**
正常执行sql返回正常结果,异常退出原因以及如何修复

**Screenshots**
![lQLPJxZqX4tmU9RGzQPBsDWklDgmZTmSAq9ZIzcA5wA_961_70](https://user-images.githubusercontent.com/52025735/174556155-1829b4e5-62ff-43fd-ab87-b3f9ba9587b6.png)

**Desktop (please complete the following information):**
- OS: [linux]
- Browser [无]
- Version [0.12.4]

**Additional context**

sql报错日志如下
2022-06-18 21:27:24,748 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:625 - root.ln_1 [Compaction] merge level-0's 6 TsFiles to next level
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-0-0.tsfile
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652286375972-1048-0-0.tsfile
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652453386626-1053-0-0.tsfile
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652618490908-1058-0-0.tsfile
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652782960971-1065-0-0.tsfile
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652946896255-1074-0-0.tsfile
2022-06-18 21:27:43,750 [pool-14-IoTDB-RPC-Client-1] INFO o.a.i.d.e.s.TsFileProcessor:151 - create a new tsfile processor /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_3/0/0/1655558863750-7-0-0.tsfile
2022-06-18 21:27:43,751 [pool-14-IoTDB-RPC-Client-1] INFO o.a.i.d.w.n.ExclusiveWriteLogNode:92 - create the WAL folder ./../data/wal/root.ln_3/0-1655558863750-7-0-0.tsfile.
2022-06-18 21:27:43,751 [pool-14-IoTDB-RPC-Client-1] INFO o.a.i.d.c.IoTDBThreadPoolFactory:87 - new single thread pool: Flush-WAL-Thread-root.ln_3/0-1655558863750-7-0-0.tsfile
2022-06-18 21:27:47,337 [pool-6-IoTDB-Compaction-1] WARN o.a.i.t.f.m.s.Statistics:185 - Statistics classes mismatched,no merge: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics v.s. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
2022-06-18 21:27:47,338 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:788 - root.ln_1-0 [Compaction][Restore] Start to restore compaction
2022-06-18 21:27:48,119 [pool-6-IoTDB-Compaction-1] INFO o.a.i.t.r.TsFileSequenceReader:1156 - TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile self-check cannot proceed at position 84028992 recovered, because : reach the end of the file.
2022-06-18 21:27:48,793 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:805 - root.ln_1-0 [Compaction][Restore] target file /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile is incomplete, delete it
2022-06-18 21:27:48,800 [pool-6-IoTDB-Compaction-1] ERROR o.a.i.d.e.c.l.LevelCompactionTsFileManagement:696 - Error occurred in Compaction Merge thread
org.apache.iotdb.tsfile.exception.filter.StatisticsClassException: Statistics classes mismatched: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics vs. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
at org.apache.iotdb.tsfile.file.metadata.statistics.Statistics.mergeStatistics(Statistics.java:187)
at org.apache.iotdb.tsfile.file.metadata.ChunkMetadata.mergeChunkMetadata(ChunkMetadata.java:269)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.readByAppendPageMerge(CompactionUtils.java:90)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.writeByAppendPageMerge(CompactionUtils.java:159)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.merge(CompactionUtils.java:400)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:638)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:526)
at org.apache.iotdb.db.engine.compaction.TsFileManagement$CompactionMergeTask.call(TsFileManagement.java:181)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.syncCompactOnePartition(StorageGroupProcessor.java:2002)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.access$100(StorageGroupProcessor.java:135)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor$CompactionAllPartitionTask.call(StorageGroupProcessor.java:524)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.merge(StorageGroupProcessor.java:2138)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-06-18 21:28:18,800 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:625 - root.ln_1 [Compaction] merge level-0's 6 TsFiles to next level
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-0-0.tsfile
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652286375972-1048-0-0.tsfile
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652453386626-1053-0-0.tsfile
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652618490908-1058-0-0.tsfile
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652782960971-1065-0-0.tsfile
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652946896255-1074-0-0.tsfile
2022-06-18 21:28:42,461 [pool-6-IoTDB-Compaction-5] WARN o.a.i.t.f.m.s.Statistics:185 - Statistics classes mismatched,no merge: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics v.s. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
2022-06-18 21:28:42,461 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:788 - root.ln_1-0 [Compaction][Restore] Start to restore compaction
2022-06-18 21:28:43,225 [pool-6-IoTDB-Compaction-5] INFO o.a.i.t.r.TsFileSequenceReader:1156 - TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile self-check cannot proceed at position 84028992 recovered, because : reach the end of the file.
2022-06-18 21:28:43,868 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:805 - root.ln_1-0 [Compaction][Restore] target file /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile is incomplete, delete it
2022-06-18 21:28:43,874 [pool-6-IoTDB-Compaction-5] ERROR o.a.i.d.e.c.l.LevelCompactionTsFileManagement:696 - Error occurred in Compaction Merge thread
org.apache.iotdb.tsfile.exception.filter.StatisticsClassException: Statistics classes mismatched: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics vs. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
at org.apache.iotdb.tsfile.file.metadata.statistics.Statistics.mergeStatistics(Statistics.java:187)
at org.apache.iotdb.tsfile.file.metadata.ChunkMetadata.mergeChunkMetadata(ChunkMetadata.java:269)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.readByAppendPageMerge(CompactionUtils.java:90)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.writeByAppendPageMerge(CompactionUtils.java:159)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.merge(CompactionUtils.java:400)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:638)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:526)
at org.apache.iotdb.db.engine.compaction.TsFileManagement$CompactionMergeTask.call(TsFileManagement.java:181)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.syncCompactOnePartition(StorageGroupProcessor.java:2002)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.access$100(StorageGroupProcessor.java:135)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor$CompactionAllPartitionTask.call(StorageGroupProcessor.java:524)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.merge(StorageGroupProcessor.java:2138)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-06-18 21:29:10,260 [pool-14-IoTDB-RPC-Client-5] INFO o.a.i.d.s.TSServiceImpl:250 - IoTDB: Login status: Login successfully. User : root, opens Session-5
2022-06-18 21:29:10,365 [pool-14-IoTDB-RPC-Client-5] INFO o.a.i.d.s.TSServiceImpl:1226 - IoTDB server version: 0.12.4
2022-06-18 21:29:13,875 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:625 - root.ln_1 [Compaction] merge level-0's 6 TsFiles to next level
2022-06-18 21:29:13,875 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-0-0.tsfile
2022-06-18 21:29:13,875 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652286375972-1048-0-0.tsfile
2022-06-18 21:29:13,876 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652453386626-1053-0-0.tsfile
2022-06-18 21:29:13,876 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652618490908-1058-0-0.tsfile
2022-06-18 21:29:13,876 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652782960971-1065-0-0.tsfile
2022-06-18 21:29:13,876 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652946896255-1074-0-0.tsfile
2022-06-18 21:29:36,894 [pool-6-IoTDB-Compaction-10] WARN o.a.i.t.f.m.s.Statistics:185 - Statistics classes mismatched,no merge: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics v.s. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
2022-06-18 21:29:36,894 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:788 - root.ln_1-0 [Compaction][Restore] Start to restore compaction
2022-06-18 21:29:37,657 [pool-6-IoTDB-Compaction-10] INFO o.a.i.t.r.TsFileSequenceReader:1156 - TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile self-check cannot proceed at position 84028992 recovered, because : reach the end of the file.
2022-06-18 21:29:38,325 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:805 - root.ln_1-0 [Compaction][Restore] target file /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile is incomplete, delete it
2022-06-18 21:29:38,332 [pool-6-IoTDB-Compaction-10] ERROR o.a.i.d.e.c.l.LevelCompactionTsFileManagement:696 - Error occurred in Compaction Merge thread
org.apache.iotdb.tsfile.exception.filter.StatisticsClassException: Statistics classes mismatched: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics vs. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
at org.apache.iotdb.tsfile.file.metadata.statistics.Statistics.mergeStatistics(Statistics.java:187)
at org.apache.iotdb.tsfile.file.metadata.ChunkMetadata.mergeChunkMetadata(ChunkMetadata.java:269)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.readByAppendPageMerge(CompactionUtils.java:90)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.writeByAppendPageMerge(CompactionUtils.java:159)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.merge(CompactionUtils.java:400)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:638)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:526)
at org.apache.iotdb.db.engine.compaction.TsFileManagement$CompactionMergeTask.call(TsFileManagement.java:181)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.syncCompactOnePartition(StorageGroupProcessor.java:2002)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.access$100(StorageGroupProcessor.java:135)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor$CompactionAllPartitionTask.call(StorageGroupProcessor.java:524)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.merge(StorageGroupProcessor.java:2138)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-06-18 21:29:44,548 [pool-14-IoTDB-RPC-Client-5] WARN o.a.i.d.s.TSServiceImpl:1976 - [INTERNAL_SERVER_ERROR] Exception occurred while executing "select last * from root.ln_2.tb_4152".
java.nio.BufferUnderflowException: null
at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:651)
at java.base/java.nio.HeapByteBuffer.getLong(HeapByteBuffer.java:454)
at org.apache.iotdb.tsfile.utils.ReadWriteIOUtils.readLong(ReadWriteIOUtils.java:545)
at org.apache.iotdb.tsfile.file.metadata.MetadataIndexNode.deserializeFrom(MetadataIndexNode.java:105)
at org.apache.iotdb.tsfile.file.metadata.TsFileMetadata.deserializeFrom(TsFileMetadata.java:55)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readFileMetadata(TsFileSequenceReader.java:261)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readBloomFilter(TsFileSequenceReader.java:276)
at org.apache.iotdb.db.engine.cache.TimeSeriesMetadataCache.get(TimeSeriesMetadataCache.java:140)
at org.apache.iotdb.db.utils.FileLoaderUtils.loadTimeSeriesMetadata(FileLoaderUtils.java:107)
at org.apache.iotdb.db.query.executor.fill.LastPointReader.retrieveValidLastPointFromSeqFiles(LastPointReader.java:106)
at org.apache.iotdb.db.query.executor.fill.LastPointReader.readLastPoint(LastPointReader.java:80)
at org.apache.iotdb.db.query.executor.LastQueryExecutor.calculateLastPairForSeriesLocally(LastQueryExecutor.java:202)
at org.apache.iotdb.db.query.executor.LastQueryExecutor.calculateLastPairForSeries(LastQueryExecutor.java:144)
at org.apache.iotdb.db.query.executor.LastQueryExecutor.execute(LastQueryExecutor.java:101)
at org.apache.iotdb.db.query.executor.QueryRouter.lastQuery(QueryRouter.java:264)
at org.apache.iotdb.db.qp.executor.PlanExecutor.processDataQuery(PlanExecutor.java:544)
at org.apache.iotdb.db.qp.executor.PlanExecutor.processQuery(PlanExecutor.java:228)
at org.apache.iotdb.db.service.TSServiceImpl.createQueryDataSet(TSServiceImpl.java:1110)
at org.apache.iotdb.db.service.TSServiceImpl.internalExecuteQueryStatement(TSServiceImpl.java:738)
at org.apache.iotdb.db.service.TSServiceImpl.executeStatement(TSServiceImpl.java:603)
at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$executeStatement.getResult(TSIService.java:2373)
at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$executeStatement.getResult(TSIService.java:2353)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-06-18 21:30:01,382 [pool-14-IoTDB-RPC-Client-5] INFO o.a.i.d.c.IoTDBThreadPoolFactory:55 - new fixed thread pool: Query, thread number: 2
2022-06-18 21:30:01,422 [pool-30-IoTDB-Query-1] ERROR o.a.i.d.q.d.RawQueryDataSetWithoutValueFilter$ReadTask:138 - Something gets wrong:
java.nio.BufferUnderflowException: null
at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:651)
at java.base/java.nio.HeapByteBuffer.getLong(HeapByteBuffer.java:454)
at org.apache.iotdb.tsfile.utils.ReadWriteIOUtils.readLong(ReadWriteIOUtils.java:545)
at org.apache.iotdb.tsfile.file.metadata.MetadataIndexNode.deserializeFrom(MetadataIndexNode.java:105)
at org.apache.iotdb.tsfile.file.metadata.TsFileMetadata.deserializeFrom(TsFileMetadata.java:55)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readFileMetadata(TsFileSequenceReader.java:261)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readBloomFilter(TsFileSequenceReader.java:276)
at org.apache.iotdb.db.engine.cache.TimeSeriesMetadataCache.get(TimeSeriesMetadataCache.java:140)
at org.apache.iotdb.db.utils.FileLoaderUtils.loadTimeSeriesMetadata(FileLoaderUtils.java:107)
at org.apache.iotdb.db.query.reader.series.SeriesReader.tryToUnpackAllOverlappedFilesToTimeSeriesMetadata(SeriesReader.java:895)
at org.apache.iotdb.db.query.reader.series.SeriesReader.hasNextFile(SeriesReader.java:242)
at org.apache.iotdb.db.query.reader.series.SeriesRawDataBatchReader.hasNextBatch(SeriesRawDataBatchReader.java:129)
at org.apache.iotdb.db.query.dataset.RawQueryDataSetWithoutValueFilter$ReadTask.runMayThrow(RawQueryDataSetWithoutValueFilter.java:88)
at org.apache.iotdb.db.concurrent.WrappedRunnable.run(WrappedRunnable.java:32)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-06-18 21:30:01,424 [pool-14-IoTDB-RPC-Client-5] ERROR o.a.i.d.q.d.RawQueryDataSetWithoutValueFilter:458 - exception happened in producer thread
java.nio.BufferUnderflowException: null
at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:651)
at java.base/java.nio.HeapByteBuffer.getLong(HeapByteBuffer.java:454)
at org.apache.iotdb.tsfile.utils.ReadWriteIOUtils.readLong(ReadWriteIOUtils.java:545)
at org.apache.iotdb.tsfile.file.metadata.MetadataIndexNode.deserializeFrom(MetadataIndexNode.java:105)
at org.apache.iotdb.tsfile.file.metadata.TsFileMetadata.deserializeFrom(TsFileMetadata.java:55)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readFileMetadata(TsFileSequenceReader.java:261)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readBloomFilter(TsFileSequenceReader.java:276)
at org.apache.iotdb.db.engine.cache.TimeSeriesMetadataCache.get(TimeSeriesMetadataCache.java:140)
at org.apache.iotdb.db.utils.FileLoaderUtils.loadTimeSeriesMetadata(FileLoaderUtils.java:107)
at org.apache.iotdb.db.query.reader.series.SeriesReader.tryToUnpackAllOverlappedFilesToTimeSeriesMetadata(SeriesReader.java:895)
at org.apache.iotdb.db.query.reader.series.SeriesReader.hasNextFile(SeriesReader.java:242)
at org.apache.iotdb.db.query.reader.series.SeriesRawDataBatchReader.hasNextBatch(SeriesRawDataBatchReader.java:129)
at org.apache.iotdb.db.query.dataset.RawQueryDataSetWithoutValueFilter$ReadTask.runMayThrow(RawQueryDataSetWithoutValueFilter.java:88)
at org.apache.iotdb.db.concurrent.WrappedRunnable.run(WrappedRunnable.java:32)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)

Contributor guide

Open the contributing guide

Research direction

Start with the compaction stack trace at Statistics.mergeStatistics, ChunkMetadata.mergeChunkMetadata, and CompactionUtils.readByAppendPageMerge. Reproduce the reported type change, TTL configuration, abnormal shutdown, restart, and SQL query on IoTDB 0.12.4, then inspect the compaction restore logs. Done means the failure is reproducible and the server can compact the affected TsFiles and execute the query normally.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.