Add abstractions for parsing TFRecord Files using `tf.Example` and `tf.io` ops
还没有人认领这个 Issue。
- 主要语言
- Java
- 星标
- 928
- 派生
- 227
- PR 合并指标
- 30 天内没有已合并 PR
描述
System information
- TensorFlow version (you are using): Latest master of TensorFlow Java
- Are you willing to contribute it (Yes/No): No (working on other things at the moment)
Describe the feature and the current behavior/state.
Currently in Java, we have access to the core tf.io ops such as tf.parseExample, tf.parseSingleExample, tf.decodeRaw etc. In order to serialize TF Record datasets and read in datasets from the tensorflow_datasets buckets, for example, we need to be easily able to use these ops.
In Python, the relevant abstractions built on top of tf.io are defined in parsing_config.py. Specifically it will be very helpful to have abstractions such as:
- Various feature types:
FixedLenFeature,SparseFeature,FixedLenSequenceFeature, etc... - The
_ParseOpParamsclass which wraps the parameters totf.parseExample - Standardizing a flow for defining features in a TFRecord file.
See these examples which relate to using the parse-example ops, and reading TFRecord files
Will this change the current api? How?
This will add APIs for serializing / parsing examples to / from TF Record files
Who will benefit with this feature?
Anyone using datasets stored as TFRecord flies from TensorFlow java (for example, to load datasets from the tensorflow_datasets GCP bucket)
Any Other info.
Feel free to get in touch with me anytime to discuss! Happy to help.
贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
调研方向
首先阅读 TensorFlow Python 的 parsing_config.py,以及 issue 中引用的 Java tf.io parse-example 操作。将列出的特征抽象和 _ParseOpParams 与现有的 Java 绑定进行比较,然后查看 TFRecord 和 tf.Example 示例。完成的标准是 Java APIs 支持定义特征,并从 TFRecord 文件中序列化和解析示例。
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- java
- 领域
- api, machine-learning
- Issue 类型
- 功能
- 难度
- 5/5
- 预计耗时
- 一周以上
- 活跃度
- 停滞
- 描述清晰度
- 基本清楚
- 新手友好度
- 25/100