tensorflow / tensorflow/models

Get/save predictions made during evaluation for object detection models

Open
#10,264 0 comments 0 reactions 3 assignees View on GitHub

@pkulzc is already working on this.

Since Sep 20, 2021.

models:research:odapi type:feature
Dominant language
Python
Stars
77.7k
Forks
44.8k
PR merge metrics
No merged PRs in 30d

Description

At present, if someone wants to evaluate and get/save predictions on same dataset for a trained model, they need to run evaluation (by running model_main_tf2.py with checkpoint_dir arguement) and inference separately, so what if the user gets an option to get and save the predictions during the evaluation itself, it can reduce need to run inference separately.

And a queries:
I have fine-tuned an SSD-Mobilenetv2 with train config fixed resize 300x300 built using tensorflow objection detection API and saved in TF Saved_Model format.
Questions:

  • How during inference it is able to accept input images of any shape (not 300x300) without the need for any preprocessing to resize to 300x300 first and then pass to the model.
  • Does it is because saved_model by default does resize during inference? (If yes, does it also normalize them because before doing convolution operations) (I am new to saved_model format but I think it is not because of saved_model, but then how is it possible - as I think SSD-Mobilenet includes FC layers which require fixed input size) OR does the architecture uses AdaptivePooling in b/w to achieve this.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.