apache / apache/iotdb

sql 执行报错

未关闭
#6,346 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Java
星标
6.4k
派生
1.2k
平均合并
1 天 23 小时
30 天内合并 PR
115

描述

**Describe the bug**

我们对iotdb时间序列的类型做过修改 例:删除double类型的root.ln_1.ph,再新增text类型的root.ln_1.ph
我们对iotdb的分组加了TTL

iotdbserver运行一段时间后异常停止,重启后执行查询sql报错

**To Reproduce**
Steps to reproduce the behavior:
1. iotdbserver运行一段时间异常退出
2. 调用启动脚本启动iotdbserver
3. 登录iotdb命令窗口,执行查询sql
4. 报截图错误

**Expected behavior**
正常执行sql返回正常结果,异常退出原因以及如何修复

**Screenshots**
![lQLPJxZqX4tmU9RGzQPBsDWklDgmZTmSAq9ZIzcA5wA_961_70](https://user-images.githubusercontent.com/52025735/174556155-1829b4e5-62ff-43fd-ab87-b3f9ba9587b6.png)

**Desktop (please complete the following information):**
- OS: [linux]
- Browser [无]
- Version [0.12.4]

**Additional context**

sql报错日志如下
2022-06-18 21:27:24,748 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:625 - root.ln_1 [Compaction] merge level-0's 6 TsFiles to next level
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-0-0.tsfile
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652286375972-1048-0-0.tsfile
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652453386626-1053-0-0.tsfile
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652618490908-1058-0-0.tsfile
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652782960971-1065-0-0.tsfile
2022-06-18 21:27:24,749 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652946896255-1074-0-0.tsfile
2022-06-18 21:27:43,750 [pool-14-IoTDB-RPC-Client-1] INFO o.a.i.d.e.s.TsFileProcessor:151 - create a new tsfile processor /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_3/0/0/1655558863750-7-0-0.tsfile
2022-06-18 21:27:43,751 [pool-14-IoTDB-RPC-Client-1] INFO o.a.i.d.w.n.ExclusiveWriteLogNode:92 - create the WAL folder ./../data/wal/root.ln_3/0-1655558863750-7-0-0.tsfile.
2022-06-18 21:27:43,751 [pool-14-IoTDB-RPC-Client-1] INFO o.a.i.d.c.IoTDBThreadPoolFactory:87 - new single thread pool: Flush-WAL-Thread-root.ln_3/0-1655558863750-7-0-0.tsfile
2022-06-18 21:27:47,337 [pool-6-IoTDB-Compaction-1] WARN o.a.i.t.f.m.s.Statistics:185 - Statistics classes mismatched,no merge: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics v.s. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
2022-06-18 21:27:47,338 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:788 - root.ln_1-0 [Compaction][Restore] Start to restore compaction
2022-06-18 21:27:48,119 [pool-6-IoTDB-Compaction-1] INFO o.a.i.t.r.TsFileSequenceReader:1156 - TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile self-check cannot proceed at position 84028992 recovered, because : reach the end of the file.
2022-06-18 21:27:48,793 [pool-6-IoTDB-Compaction-1] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:805 - root.ln_1-0 [Compaction][Restore] target file /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile is incomplete, delete it
2022-06-18 21:27:48,800 [pool-6-IoTDB-Compaction-1] ERROR o.a.i.d.e.c.l.LevelCompactionTsFileManagement:696 - Error occurred in Compaction Merge thread
org.apache.iotdb.tsfile.exception.filter.StatisticsClassException: Statistics classes mismatched: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics vs. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
at org.apache.iotdb.tsfile.file.metadata.statistics.Statistics.mergeStatistics(Statistics.java:187)
at org.apache.iotdb.tsfile.file.metadata.ChunkMetadata.mergeChunkMetadata(ChunkMetadata.java:269)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.readByAppendPageMerge(CompactionUtils.java:90)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.writeByAppendPageMerge(CompactionUtils.java:159)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.merge(CompactionUtils.java:400)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:638)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:526)
at org.apache.iotdb.db.engine.compaction.TsFileManagement$CompactionMergeTask.call(TsFileManagement.java:181)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.syncCompactOnePartition(StorageGroupProcessor.java:2002)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.access$100(StorageGroupProcessor.java:135)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor$CompactionAllPartitionTask.call(StorageGroupProcessor.java:524)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.merge(StorageGroupProcessor.java:2138)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-06-18 21:28:18,800 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:625 - root.ln_1 [Compaction] merge level-0's 6 TsFiles to next level
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-0-0.tsfile
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652286375972-1048-0-0.tsfile
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652453386626-1053-0-0.tsfile
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652618490908-1058-0-0.tsfile
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652782960971-1065-0-0.tsfile
2022-06-18 21:28:18,801 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652946896255-1074-0-0.tsfile
2022-06-18 21:28:42,461 [pool-6-IoTDB-Compaction-5] WARN o.a.i.t.f.m.s.Statistics:185 - Statistics classes mismatched,no merge: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics v.s. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
2022-06-18 21:28:42,461 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:788 - root.ln_1-0 [Compaction][Restore] Start to restore compaction
2022-06-18 21:28:43,225 [pool-6-IoTDB-Compaction-5] INFO o.a.i.t.r.TsFileSequenceReader:1156 - TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile self-check cannot proceed at position 84028992 recovered, because : reach the end of the file.
2022-06-18 21:28:43,868 [pool-6-IoTDB-Compaction-5] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:805 - root.ln_1-0 [Compaction][Restore] target file /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile is incomplete, delete it
2022-06-18 21:28:43,874 [pool-6-IoTDB-Compaction-5] ERROR o.a.i.d.e.c.l.LevelCompactionTsFileManagement:696 - Error occurred in Compaction Merge thread
org.apache.iotdb.tsfile.exception.filter.StatisticsClassException: Statistics classes mismatched: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics vs. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
at org.apache.iotdb.tsfile.file.metadata.statistics.Statistics.mergeStatistics(Statistics.java:187)
at org.apache.iotdb.tsfile.file.metadata.ChunkMetadata.mergeChunkMetadata(ChunkMetadata.java:269)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.readByAppendPageMerge(CompactionUtils.java:90)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.writeByAppendPageMerge(CompactionUtils.java:159)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.merge(CompactionUtils.java:400)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:638)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:526)
at org.apache.iotdb.db.engine.compaction.TsFileManagement$CompactionMergeTask.call(TsFileManagement.java:181)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.syncCompactOnePartition(StorageGroupProcessor.java:2002)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.access$100(StorageGroupProcessor.java:135)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor$CompactionAllPartitionTask.call(StorageGroupProcessor.java:524)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.merge(StorageGroupProcessor.java:2138)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-06-18 21:29:10,260 [pool-14-IoTDB-RPC-Client-5] INFO o.a.i.d.s.TSServiceImpl:250 - IoTDB: Login status: Login successfully. User : root, opens Session-5
2022-06-18 21:29:10,365 [pool-14-IoTDB-RPC-Client-5] INFO o.a.i.d.s.TSServiceImpl:1226 - IoTDB server version: 0.12.4
2022-06-18 21:29:13,875 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:625 - root.ln_1 [Compaction] merge level-0's 6 TsFiles to next level
2022-06-18 21:29:13,875 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-0-0.tsfile
2022-06-18 21:29:13,875 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652286375972-1048-0-0.tsfile
2022-06-18 21:29:13,876 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652453386626-1053-0-0.tsfile
2022-06-18 21:29:13,876 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652618490908-1058-0-0.tsfile
2022-06-18 21:29:13,876 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652782960971-1065-0-0.tsfile
2022-06-18 21:29:13,876 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:631 - root.ln_1 [Compaction] start to merge TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652946896255-1074-0-0.tsfile
2022-06-18 21:29:36,894 [pool-6-IoTDB-Compaction-10] WARN o.a.i.t.f.m.s.Statistics:185 - Statistics classes mismatched,no merge: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics v.s. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
2022-06-18 21:29:36,894 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:788 - root.ln_1-0 [Compaction][Restore] Start to restore compaction
2022-06-18 21:29:37,657 [pool-6-IoTDB-Compaction-10] INFO o.a.i.t.r.TsFileSequenceReader:1156 - TsFile /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile self-check cannot proceed at position 84028992 recovered, because : reach the end of the file.
2022-06-18 21:29:38,325 [pool-6-IoTDB-Compaction-10] INFO o.a.i.d.e.c.l.LevelCompactionTsFileManagement:805 - root.ln_1-0 [Compaction][Restore] target file /opt/soft/apache-iotdb-0.12.4-server-bin/sbin/./../data/data/sequence/root.ln_1/0/0/1652124977275-1041-1-0.tsfile is incomplete, delete it
2022-06-18 21:29:38,332 [pool-6-IoTDB-Compaction-10] ERROR o.a.i.d.e.c.l.LevelCompactionTsFileManagement:696 - Error occurred in Compaction Merge thread
org.apache.iotdb.tsfile.exception.filter.StatisticsClassException: Statistics classes mismatched: class org.apache.iotdb.tsfile.file.metadata.statistics.BinaryStatistics vs. class org.apache.iotdb.tsfile.file.metadata.statistics.BooleanStatistics
at org.apache.iotdb.tsfile.file.metadata.statistics.Statistics.mergeStatistics(Statistics.java:187)
at org.apache.iotdb.tsfile.file.metadata.ChunkMetadata.mergeChunkMetadata(ChunkMetadata.java:269)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.readByAppendPageMerge(CompactionUtils.java:90)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.writeByAppendPageMerge(CompactionUtils.java:159)
at org.apache.iotdb.db.engine.compaction.utils.CompactionUtils.merge(CompactionUtils.java:400)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:638)
at org.apache.iotdb.db.engine.compaction.level.LevelCompactionTsFileManagement.merge(LevelCompactionTsFileManagement.java:526)
at org.apache.iotdb.db.engine.compaction.TsFileManagement$CompactionMergeTask.call(TsFileManagement.java:181)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.syncCompactOnePartition(StorageGroupProcessor.java:2002)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.access$100(StorageGroupProcessor.java:135)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor$CompactionAllPartitionTask.call(StorageGroupProcessor.java:524)
at org.apache.iotdb.db.engine.storagegroup.StorageGroupProcessor.merge(StorageGroupProcessor.java:2138)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-06-18 21:29:44,548 [pool-14-IoTDB-RPC-Client-5] WARN o.a.i.d.s.TSServiceImpl:1976 - [INTERNAL_SERVER_ERROR] Exception occurred while executing "select last * from root.ln_2.tb_4152".
java.nio.BufferUnderflowException: null
at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:651)
at java.base/java.nio.HeapByteBuffer.getLong(HeapByteBuffer.java:454)
at org.apache.iotdb.tsfile.utils.ReadWriteIOUtils.readLong(ReadWriteIOUtils.java:545)
at org.apache.iotdb.tsfile.file.metadata.MetadataIndexNode.deserializeFrom(MetadataIndexNode.java:105)
at org.apache.iotdb.tsfile.file.metadata.TsFileMetadata.deserializeFrom(TsFileMetadata.java:55)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readFileMetadata(TsFileSequenceReader.java:261)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readBloomFilter(TsFileSequenceReader.java:276)
at org.apache.iotdb.db.engine.cache.TimeSeriesMetadataCache.get(TimeSeriesMetadataCache.java:140)
at org.apache.iotdb.db.utils.FileLoaderUtils.loadTimeSeriesMetadata(FileLoaderUtils.java:107)
at org.apache.iotdb.db.query.executor.fill.LastPointReader.retrieveValidLastPointFromSeqFiles(LastPointReader.java:106)
at org.apache.iotdb.db.query.executor.fill.LastPointReader.readLastPoint(LastPointReader.java:80)
at org.apache.iotdb.db.query.executor.LastQueryExecutor.calculateLastPairForSeriesLocally(LastQueryExecutor.java:202)
at org.apache.iotdb.db.query.executor.LastQueryExecutor.calculateLastPairForSeries(LastQueryExecutor.java:144)
at org.apache.iotdb.db.query.executor.LastQueryExecutor.execute(LastQueryExecutor.java:101)
at org.apache.iotdb.db.query.executor.QueryRouter.lastQuery(QueryRouter.java:264)
at org.apache.iotdb.db.qp.executor.PlanExecutor.processDataQuery(PlanExecutor.java:544)
at org.apache.iotdb.db.qp.executor.PlanExecutor.processQuery(PlanExecutor.java:228)
at org.apache.iotdb.db.service.TSServiceImpl.createQueryDataSet(TSServiceImpl.java:1110)
at org.apache.iotdb.db.service.TSServiceImpl.internalExecuteQueryStatement(TSServiceImpl.java:738)
at org.apache.iotdb.db.service.TSServiceImpl.executeStatement(TSServiceImpl.java:603)
at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$executeStatement.getResult(TSIService.java:2373)
at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$executeStatement.getResult(TSIService.java:2353)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-06-18 21:30:01,382 [pool-14-IoTDB-RPC-Client-5] INFO o.a.i.d.c.IoTDBThreadPoolFactory:55 - new fixed thread pool: Query, thread number: 2
2022-06-18 21:30:01,422 [pool-30-IoTDB-Query-1] ERROR o.a.i.d.q.d.RawQueryDataSetWithoutValueFilter$ReadTask:138 - Something gets wrong:
java.nio.BufferUnderflowException: null
at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:651)
at java.base/java.nio.HeapByteBuffer.getLong(HeapByteBuffer.java:454)
at org.apache.iotdb.tsfile.utils.ReadWriteIOUtils.readLong(ReadWriteIOUtils.java:545)
at org.apache.iotdb.tsfile.file.metadata.MetadataIndexNode.deserializeFrom(MetadataIndexNode.java:105)
at org.apache.iotdb.tsfile.file.metadata.TsFileMetadata.deserializeFrom(TsFileMetadata.java:55)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readFileMetadata(TsFileSequenceReader.java:261)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readBloomFilter(TsFileSequenceReader.java:276)
at org.apache.iotdb.db.engine.cache.TimeSeriesMetadataCache.get(TimeSeriesMetadataCache.java:140)
at org.apache.iotdb.db.utils.FileLoaderUtils.loadTimeSeriesMetadata(FileLoaderUtils.java:107)
at org.apache.iotdb.db.query.reader.series.SeriesReader.tryToUnpackAllOverlappedFilesToTimeSeriesMetadata(SeriesReader.java:895)
at org.apache.iotdb.db.query.reader.series.SeriesReader.hasNextFile(SeriesReader.java:242)
at org.apache.iotdb.db.query.reader.series.SeriesRawDataBatchReader.hasNextBatch(SeriesRawDataBatchReader.java:129)
at org.apache.iotdb.db.query.dataset.RawQueryDataSetWithoutValueFilter$ReadTask.runMayThrow(RawQueryDataSetWithoutValueFilter.java:88)
at org.apache.iotdb.db.concurrent.WrappedRunnable.run(WrappedRunnable.java:32)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-06-18 21:30:01,424 [pool-14-IoTDB-RPC-Client-5] ERROR o.a.i.d.q.d.RawQueryDataSetWithoutValueFilter:458 - exception happened in producer thread
java.nio.BufferUnderflowException: null
at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:651)
at java.base/java.nio.HeapByteBuffer.getLong(HeapByteBuffer.java:454)
at org.apache.iotdb.tsfile.utils.ReadWriteIOUtils.readLong(ReadWriteIOUtils.java:545)
at org.apache.iotdb.tsfile.file.metadata.MetadataIndexNode.deserializeFrom(MetadataIndexNode.java:105)
at org.apache.iotdb.tsfile.file.metadata.TsFileMetadata.deserializeFrom(TsFileMetadata.java:55)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readFileMetadata(TsFileSequenceReader.java:261)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readBloomFilter(TsFileSequenceReader.java:276)
at org.apache.iotdb.db.engine.cache.TimeSeriesMetadataCache.get(TimeSeriesMetadataCache.java:140)
at org.apache.iotdb.db.utils.FileLoaderUtils.loadTimeSeriesMetadata(FileLoaderUtils.java:107)
at org.apache.iotdb.db.query.reader.series.SeriesReader.tryToUnpackAllOverlappedFilesToTimeSeriesMetadata(SeriesReader.java:895)
at org.apache.iotdb.db.query.reader.series.SeriesReader.hasNextFile(SeriesReader.java:242)
at org.apache.iotdb.db.query.reader.series.SeriesRawDataBatchReader.hasNextBatch(SeriesRawDataBatchReader.java:129)
at org.apache.iotdb.db.query.dataset.RawQueryDataSetWithoutValueFilter$ReadTask.runMayThrow(RawQueryDataSetWithoutValueFilter.java:88)
at org.apache.iotdb.db.concurrent.WrappedRunnable.run(WrappedRunnable.java:32)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)

贡献指南

打开贡献指南

调研方向

从 Statistics.mergeStatistics、ChunkMetadata.mergeChunkMetadata 和 CompactionUtils.readByAppendPageMerge 的 compaction 堆栈跟踪开始。在 IoTDB 0.12.4 上复现报告的类型变更、TTL 配置、异常关闭、重启和 SQL 查询,然后检查 compaction 恢复日志。复现该故障,并且服务器能够对受影响的 TsFiles 执行 compaction 以及正常执行查询,即表示完成。

由索引模型根据 Issue 内容生成。

评估

技术栈
java
领域
databases
Issue 类型
缺陷
难度
4/5
预计耗时
3-5 天
活跃度
停滞
描述清晰度
需要澄清
新手友好度
35/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。