[SUPPORT] Does AWS Redshift Spectrum fully support Hudi meta table features like column stats and bloom filters?
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
I’m trying to understand how well AWS Redshift Spectrum supports data skipping when working with Hudi datasets.
From the [Athena documentation](https://docs.aws.amazon.com/athena/latest/ug/querying-hudi-metadata-table.html), it’s clear that Athena supports file listing from Hudi’s meta table but doesn’t utilize features like column statistics or bloom filters for data skipping. However, the official docs do not mention this for Redshift Spectrum.
Does anyone know if Redshift Spectrum, Supports column statistics and bloom filters from Hudi’s meta table for query optimization?
or it Works the same as Athena by only supporting file listing?
Any clarification or references would be really helpful. Thanks!
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the linked Athena documentation, then look for official Redshift Spectrum references covering Hudi metadata tables, column statistics, and bloom filters. Document whether Spectrum supports these features or only file listing, including authoritative references.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws
- Domain
- data-engineering
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100