apache / apache/beam

Key only reads from Google Datastore

Open
#18,423 1 comment 0 reactions 0 assignees View on GitHub
gcp io java new feature P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

Currently there is no functionality allowing to read only keys from the Google Datastore through the Datastore IO. In some cases users don't need to read the whole entity, e.g. to filter by certain values in ancestry. This seems to be an important feature as the entity reads are expensive and thus the native Datastore client/API allow to run Key Only queries.

Imported from Jira [BEAM-2819](https://issues.apache.org/jira/browse/BEAM-2819). Original Jira may contain additional context.
Reported by: ilnar.

Contributor guide

Open the contributing guide

Research direction

Start by locating the Google Datastore IO and its query construction, then review how the native Datastore API represents Key Only queries. Add a way for reads to request keys without full entities, and add coverage showing that the resulting query returns keys for ancestry filtering.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.