apache / apache/hudi

[SUPPORT] Does AWS Redshift Spectrum fully support Hudi meta table features like column stats and bloom filters?

Open
#12,674 3 comments 0 reactions 0 assignees View on GitHub
area:aws
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

I’m trying to understand how well AWS Redshift Spectrum supports data skipping when working with Hudi datasets.

From the [Athena documentation](https://docs.aws.amazon.com/athena/latest/ug/querying-hudi-metadata-table.html), it’s clear that Athena supports file listing from Hudi’s meta table but doesn’t utilize features like column statistics or bloom filters for data skipping. However, the official docs do not mention this for Redshift Spectrum.

Does anyone know if Redshift Spectrum, Supports column statistics and bloom filters from Hudi’s meta table for query optimization?
or it Works the same as Athena by only supporting file listing?

Any clarification or references would be really helpful. Thanks!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked Athena documentation, then look for official Redshift Spectrum references covering Hudi metadata tables, column statistics, and bloom filters. Document whether Spectrum supports these features or only file listing, including authoritative references.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
data-engineering
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.