apache / apache/parquet-format
Token Bloom filter Support
- Dominant language
- Thrift
- Stars
- 2.6k
- Forks
- 508
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 4
Description
### Describe the enhancement requested
Database like ClickHouse support bloom filters on the tokens present in a String rather than the String itself.
https://clickhouse.com/docs/optimize/skipping-indexes#bloom-filter-types
I suggest that Apache Parquet support this type of Bloom filter to speed up token matching or SQL `like` operations.
Contributor guide
Research direction
Start with the linked ClickHouse bloom-filter types documentation and the Parquet format project; no source file, test, or entry point is identified in the issue. Determine the required token-filter semantics and format changes for token matching or SQL LIKE operations, with completion defined by an agreed design and corresponding Parquet support and validation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- clickhouse, sql
- Domain
- databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100