tensorflow / tensorflow/models

Disabling the return of particular outputs from TF Serving

Open
#9,621 0 comments 0 reactions 3 assignees View on GitHub

@pkulzc is already working on this.

Since Jan 11, 2021.

models:research:odapi type:feature
Dominant language
Python
Stars
77.7k
Forks
44.8k
PR merge metrics
No merged PRs in 30d

Description

Prerequisites

Please answer the following question for yourself before submitting an issue.

  • [DONE] I checked to make sure that this feature has not been requested already.

1. The entire URL of the file you are using

https://github.com/tensorflow/models/blob/master/research/object_detection/configs/tf2/mask_rcnn_inception_resnet_v2_1024x1024_coco17_gpu-8.config

2. Describe the feature you request

I want to be able to disable certain outputs from the model. When hosted with TF Serving the model returns 5GB of data. The mask_predictions output has a size of 3669.36MB and the box_classifier_features output has a size of 1156.30MB. It is unreasonable to transfer this much data for every inference made with the model.

3. Additional context

4. Are you willing to contribute it? (Yes or No)

No

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.