tensorflow / tensorflow/datasets
PythonDataSource is creating a repr
Open
Nobody has claimed this yet.
bug
- Dominant language
- Python
- Stars
- 4.6k
- Forks
- 1.6k
- Avg merge
- 3h 54m
- Merged PRs (30d)
- 1
Description
PythonDataSource has repr defined on it by the data class. This results in the flat examples getting serialized. This can be a huge performance penalty. The other sources have their repr's defined by the base class. Therefore, it's relatively safe to do this for tensor flow dataset as well.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Locate PythonDataSource and compare its generated repr with the base-class repr implementations used by the other sources. Inspect how flat examples are serialized and verify that TensorFlow dataset representations no longer trigger unnecessary serialization or the reported performance penalty.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, tensorflow
- Domain
- data, machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 42/100