apache / apache/gluten

[VL] BloomFilter version mismatch

Open
#9,867 1 comment 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Backend

VL (Velox)

### Bug description

TPCDS query17 fails with below error
```
org.apache.gluten.exception.GlutenException: Exception: VeloxUserError
Error Source: USER
Error Code: INVALID_ARGUMENT
Reason: (1 vs. 0)
Retriable: False
DisplayReason: False
Expression: kBloomFilterV1 == version
Function: merge
File: /var/git/Velox/velox/common/base/BloomFilter.h
```

### Gluten version

Gluten-1.3

### Spark version

Spark-3.5.x

### Spark configurations

```
spark.conf.set("spark.gluten.sql.columnar.project", "false")
spark.conf.set("spark.gluten.sql.columnar.wholeStage.fallback.threshold", "1")
spark.conf.set("spark.gluten.sql.columnar.fallback.ignoreRowToColumnar", "false")
```

### System information

_No response_

### Relevant logs

```bash

```

Contributor guide

Open the contributing guide

Research direction

Reproduce TPCDS query17 with the listed Spark configurations, then inspect Velox/velox/common/base/BloomFilter.h at BloomFilter::merge where kBloomFilterV1 is compared with version. Compare the versions reaching that path and use the reported Gluten 1.3 and Spark 3.5.x environment to isolate the mismatch. Done means query17 no longer fails with this version error.

Written by the indexing model from the issue text.

Assessment

Tech stack
spark, sql
Domain
backend, data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.