google / google/scaaml

Make ExampleIterator parse in parallel

Open
#100 0 comments 0 reactions 1 assignee Claimed by @kralka View on GitHub
Dominant language
Python
Stars
207
Forks
62
Avg merge
12h 23m
Merged PRs (30d)
4

Description

Instead of Shard.read use tf.data.Dataset to read in parallel.

Pros: faster reads means faster checking for trace statistics.

Cons: None?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.