apache / apache/pinot

PinotOutputFormatTest.testPinotOutputFormat fails with java.lang.NoSuchMethodError

Open
#7,015 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

Our internal CI picked up a consistent regression with the `PinotOutputFormatTest` from pinot-hadoop.

The build is running using docker image `3.6.3-adoptopenjdk-8` and running the with `mvn verify -Pbin-dist`.

```
[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 6.512 s <<< FAILURE! - in org.apache.pinot.hadoop.io.PinotOutputFormatTest
[ERROR] org.apache.pinot.hadoop.io.PinotOutputFormatTest.testPinotOutputFormat Time elapsed: 5.95 s <<< FAILURE!
java.lang.NoSuchMethodError: org.reflections.util.ConfigurationBuilder.filterInputsBy(Lcom/google/common/base/Predicate;)Lorg/reflections/util/ConfigurationBuilder;
at org.apache.pinot.segment.spi.loader.SegmentDirectoryLoaderRegistry.(SegmentDirectoryLoaderRegistry.java:49)
at org.apache.pinot.segment.local.segment.index.converter.SegmentV1V2ToV3FormatConverter.copyIndexData(SegmentV1V2ToV3FormatConverter.java:143)
at org.apache.pinot.segment.local.segment.index.converter.SegmentV1V2ToV3FormatConverter.convert(SegmentV1V2ToV3FormatConverter.java:89)
at org.apache.pinot.segment.local.segment.creator.impl.SegmentIndexCreationDriverImpl.convertFormatIfNecessary(SegmentIndexCreationDriverImpl.java:371)
at org.apache.pinot.segment.local.segment.creator.impl.SegmentIndexCreationDriverImpl.handlePostCreation(SegmentIndexCreationDriverImpl.java:304)
at org.apache.pinot.segment.local.segment.creator.impl.SegmentIndexCreationDriverImpl.build(SegmentIndexCreationDriverImpl.java:257)
at org.apache.pinot.hadoop.io.PinotRecordWriter.createSegment(PinotRecordWriter.java:106)
at org.apache.pinot.hadoop.io.PinotRecordWriter.close(PinotRecordWriter.java:92)
at org.apache.pinot.hadoop.io.PinotOutputFormatTest.testPinotOutputFormat(PinotOutputFormatTest.java:90)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
```

Contributor guide

Open the contributing guide

Research direction

Reproduce the failure with the 3.6.3-adoptopenjdk-8 Docker image using `mvn verify -Pbin-dist`, then start from `PinotOutputFormatTest.testPinotOutputFormat` and the `SegmentDirectoryLoaderRegistry` stack-trace entry. Done means the test completes without the reported `NoSuchMethodError`.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, java
Domain
build-system, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.