tensorflow / tensorflow/datasets
Control over extracted folders naming
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.6k
- Forks
- 1.6k
- Avg merge
- 3h 54m
- Merged PRs (30d)
- 1
Description
Hello,
I often encounter the situation where I want to 'explore' or inspect the raw data (which is downloaded and extracted) before treating it and preprocessing it into TFRecord files.
However, the naming of those folders (resulting from the extraction) (based on a hashing of the checksum and the url if I understood this line) makes it hard because names are non-human friendly.
I was wondering whether controlling this behavior would be possible,
Thanks
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Read tensorflow_datasets/core/download/resource.py around the linked line to understand how extracted folder names are derived from the checksum and URL. Determine where a user-facing naming option could be defined and identify existing download or extraction tests; done means users can control the extracted folder naming without breaking cache behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100