tensorflow / tensorflow/datasets

TFDS load creates directory literally named "~"

Open
#4,117 2 comments 3 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Python
Stars
4.6k
Forks
1.6k
Avg merge
3h 54m
Merged PRs (30d)
1

Description

Repro snippet:

Please cd into a directory that is NOT your home directory ~ before running

tfds.load(name="caltech_birds2011", shuffle_files=True)

Result: a directory literally named '~' is created in the current directory, in addition to the ~/tensorflow_datasets directory that is correctly created in the user's home dir . Files are then created under this bizarre '' dir making them very difficult to locate. This seems to be happening during the decompression or tfrecords generation process.

  • Operating System: Linux (Vertex AI Workbench default)

  • Python version: 3.6

  • tensorflow-datasets/tfds-nightly version: 4.6.0

  • tensorflow/tf-nightly version: 2.9.1

  • Does the issue still exists with the last tfds-nightly package (pip install --upgrade tfds-nightly) YES

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the tfds.load(name="caltech_birds2011", shuffle_files=True) entry point and trace the decompression or TFRecord-generation path described in the report. Reproduce from a directory outside the home directory; done means no literal '~' directory is created and generated files remain under ~/tensorflow_datasets.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
data
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.