tensorflow / tensorflow/models
Slow inference
Open
@pkulzc is already working on this.
Since Apr 1, 2021.
models:research:odapi
type:performance
- Dominant language
- Python
- Stars
- 77.7k
- Forks
- 44.8k
- PR merge metrics
- No merged PRs in 30d
Description
Prerequisites
Please answer the following questions for yourself before submitting an issue.
- I am using the latest TensorFlow Model Garden release and TensorFlow 2.
- I am reporting the issue to the correct repository. (Model Garden official or research directory)
- I checked to make sure that this issue has not already been filed.
1. The entire URL of the file you are using
https://github.com/tensorflow/models/tree/master/research/object_detection/exporter_main_v2.py
2. Describe the bug
The exported model is really slow. More 20 sec to load and 5 sec to do inference in a new image.
3. Steps to reproduce
I have exported a trained model using the previous file. Now I have a model :
faster_rcnn_model/
├─ checkpoint/
├─ saved_model/
├─ label_map.pbtxt
└─ pipeline.config
4. Expected behavior
I would like to improve the speed to use it.
5. Additional context
Include any logs that would be helpful to diagnose the problem.
6. System information
- TensorFlow version (use command below): 2.2.3
- Python version: 3.6.8
- CUDA/cuDNN version: 10.1.105/7.6.4.38
- GPU model and memory:
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.