apache / apache/beam

Update GCSFileSystem to support glob patterns of the form {x,y,z}

Open
#18,431 0 comments 0 reactions 0 assignees View on GitHub
gcp improvement io java P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 5h
Merged PRs (30d)
204

Description

Currently glob patterns of the form {x,y,z} (where either one of these values is valid) are not supported by GCSFileSystem. See http://docs.oracle.com/javase/tutorial/essential/io/fileOps.html#glob for the definition of Java glob patterns.

We should also update documentation to clarify that support for glob-patterns is file-system dependent.

Also applies to Python SDK.

Imported from Jira [BEAM-2683](https://issues.apache.org/jira/browse/BEAM-2683). Original Jira may contain additional context.
Reported by: chamikara.

Contributor guide

Open the contributing guide

Research direction

Start by locating the Java GCSFileSystem implementation and the corresponding Python SDK implementation, then inspect how each handles glob patterns. Check the existing documentation for filesystem glob support and update both SDKs and the documentation so brace patterns such as {x,y,z} are supported where applicable and filesystem-dependent behavior is clear.

Written by the indexing model from the issue text.

Assessment

Tech stack
google-cloud, java, python
Domain
cloud, documentation
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.