Add support for progress reporting to Firestore Query Source
Open
extensions
gcp
improvement
java
P3
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Today, Firestore does not provide any metadata about the expected number of results of a query and prevents incremental progress from being communicated to Beam.
Imported from Jira [BEAM-12606](https://issues.apache.org/jira/browse/BEAM-12606). Original Jira may contain additional context.
Reported by: benwhitehead@google.com.
Contributor guide
Research direction
Start by locating the Firestore Query Source implementation in Apache Beam and review the linked Jira issue BEAM-12606 for additional context. Determine how progress is represented in Beam, then verify that Firestore query progress can be communicated incrementally to Beam.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100