fsspec / fsspec/gcsfs

File paths with "#" characters cannot be opened.

Open
#270 5 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
398
Forks
181
Avg merge
2d 10h
Merged PRs (30d)
36

Description

What happened: Experienced FileNotFoundError while trying to open a file whose name contains # character.

What you expected to happen: The expected case is that GCSFileSystem can properly open the specified file independent of its name.

Minimal Complete Verifiable Example:

import gcsfs
fs = gcsfs.GCSFileSystem(project="my-project-id")
file_path = "my-bucket-name/data-folder/#my-data.json"
fp = fs.open(file_path, mode="r")

Anything else we need to know?: I tried to reproduce the issue with other special characters like $ but I couldn't.

Environment:

  • gcsfs version: 0.6.1
  • Dask version: 2.14.0
  • Python version: 3.6.9
  • Operating System: Linux, Debian 9
  • Install method (conda, pip, source): pip

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the GCSFileSystem.open entry point and reproduce the provided example with the path my-bucket-name/data-folder/#my-data.json. Trace how the path is handled when opening the object; done means a GCS path containing # opens successfully without FileNotFoundError.

Written by the indexing model from the issue text.

Assessment

Tech stack
google-cloud, python
Domain
cloud
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.