apache / apache/parquet-format

Token Bloom filter Support

Open
#489 6 comments 0 reactions 0 assignees View on GitHub
Type: enhancement
Dominant language
Thrift
Stars
2.6k
Forks
508
Avg merge
2d 8h
Merged PRs (30d)
4

Description

### Describe the enhancement requested

Database like ClickHouse support bloom filters on the tokens present in a String rather than the String itself.

https://clickhouse.com/docs/optimize/skipping-indexes#bloom-filter-types

I suggest that Apache Parquet support this type of Bloom filter to speed up token matching or SQL `like` operations.

Contributor guide

Open the contributing guide

Research direction

Start with the linked ClickHouse bloom-filter types documentation and the Parquet format project; no source file, test, or entry point is identified in the issue. Determine the required token-filter semantics and format changes for token matching or SQL LIKE operations, with completion defined by an agreed design and corresponding Parquet support and validation.

Written by the indexing model from the issue text.

Assessment

Tech stack
clickhouse, sql
Domain
databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.