github / github/codeql

Create AOSP C/C++ database failed with the error tip that "Brotli stream decoding failed"

未关闭
#13,495 7 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
question
主要语言
CodeQL
星标
10.1k
派生
2.1k
平均合并
2 天 15 小时
30 天内合并 PR
141

描述

AOSP branch: Master

command:
```
codeql database create out/codeql_aosp \
--language=cpp \
--command="`pwd`/mmm.sh " \
--source-root=./ \
--overwrite \
--threads=12 \
--ram=3276

mmm.sh:
#!/bin/bash
cd $1
source ./build/envsetup.sh
export ALLOW_NINJA_ENV=1
lunch aosp_arm64-eng
make -j12
```

Error msg:
```
Finalizing database at /SSD/Aosp/out/codeql_aosp.
string.2153232f.trap (CodecServiceRegistrant.cpp.9fbaf9e5_0.trap.tar.br) for 2 link targets, 47157: java.io.IOException: Brotli stream decoding failed
org.brotli.dec.BrotliInputStream.read(BrotliInputStream.java:151)
org.apache.commons.compress.archivers.tar.TarArchiveInputStream.read(TarArchiveInputStream.java:608)
java.base/java.io.FilterInputStream.read(Unknown Source)
com.semmle.inmemory.trap.TrapInputStream.read(TrapInputStream.java:61)
com.semmle.inmemory.trap.TrapScanner.fill(TrapScanner.java:509)
com.semmle.inmemory.trap.TrapScanner.ensureNext(TrapScanner.java:486)
com.semmle.inmemory.trap.TrapScanner.identOrLabelRest(TrapScanner.java:182)
com.semmle.inmemory.trap.TrapScanner.nextToken(TrapScanner.java:127)
com.semmle.inmemory.trap.TRAPReader.scanOneField(TRAPReader.java:864)
com.semmle.inmemory.trap.TRAPReader.scanTuple(TRAPReader.java:601)
com.semmle.inmemory.trap.TRAPReader.scanTuplesAndLabels(TRAPReader.java:523)
com.semmle.inmemory.trap.TRAPReader.importTuples(TRAPReader.java:423)
com.semmle.inmemory.trap.ImportTasksProcessor.process(ImportTasksProcessor.java:193)
com.semmle.inmemory.trap.ImportTasksProcessor.lambda$importTrap$1(ImportTasksProcessor.java:153)
com.semmle.util.concurrent.FutureUtils.lambda$mapAsync_$8(FutureUtils.java:136)
java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base/java.lang.Thread.run(Unknown Source)

... caused by:

org.brotli.dec.BrotliRuntimeException: Invalid backward reference
org.brotli.dec.Decode.decompress(Decode.java:887)
org.brotli.dec.BrotliInputStream.read(BrotliInputStream.java:145)
org.apache.commons.compress.archivers.tar.TarArchiveInputStream.read(TarArchiveInputStream.java:608)
java.base/java.io.FilterInputStream.read(Unknown Source)
com.semmle.inmemory.trap.TrapInputStream.read(TrapInputStream.java:61)
com.semmle.inmemory.trap.TrapScanner.fill(TrapScanner.java:509)
com.semmle.inmemory.trap.TrapScanner.ensureNext(TrapScanner.java:486)
com.semmle.inmemory.trap.TrapScanner.identOrLabelRest(TrapScanner.java:182)
com.semmle.inmemory.trap.TrapScanner.nextToken(TrapScanner.java:127)
com.semmle.inmemory.trap.TRAPReader.scanOneField(TRAPReader.java:864)
com.semmle.inmemory.trap.TRAPReader.scanTuple(TRAPReader.java:601)
com.semmle.inmemory.trap.TRAPReader.scanTuplesAndLabels(TRAPReader.java:523)
com.semmle.inmemory.trap.TRAPReader.importTuples(TRAPReader.java:423)
com.semmle.inmemory.trap.ImportTasksProcessor.process(ImportTasksProcessor.java:193)
com.semmle.inmemory.trap.ImportTasksProcessor.lambda$importTrap$1(ImportTasksProcessor.java:153)
com.semmle.util.concurrent.FutureUtils.lambda$mapAsync_$8(FutureUtils.java:136)
java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base/java.lang.Thread.run(Unknown Source)
at (failed to read line: asked for -131036 bytes which seems wrong!)
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
Empty sub-key {} found in key '@"type_decl_F_nonproto[class_complete]_18d15b6bcfe2"'
```

贡献指南

打开贡献指南

调研方向

Start with the provided mmm.sh script and CodeQL database-create command, then inspect the finalization failure for CodecServiceRegistrant.cpp. Reproduce the AOSP build and determine why the generated .trap.tar.br artifact cannot be decoded. Done means the database finalizes successfully without the Brotli or malformed-key errors.

由索引模型根据 Issue 内容生成。

评估

技术栈
cpp, shell
领域
build-system, devtools
Issue 类型
缺陷
难度
4/5
预计耗时
3-5 天
活跃度
停滞
描述清晰度
需要澄清
新手友好度
25/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。