iree-org / iree-org/iree

Add lowering for detection post-processing models

Open
#8,577 0 comments 0 reactions 1 assignee View on GitHub

@rsuderman is already working on this.

Since Mar 18, 2022.

enhancement ➕ integrations/tosa
Dominant language
C++
Stars
3.9k
Forks
1k
Avg merge
4d 16h
Merged PRs (30d)
47

Description

SSD-based object detection models have a post-processing op that is usually not included in the TFLite model, or is added post-training as a TFLite custom op. This part of the pipeline tends to run on the CPU and is becoming a bottleneck, especially in mobile environments where it is becoming common for the model to run on accelerators.

This is a feature request to add support for the ops used in post-processing so that it too can leverage compiler optimizations and acceleration.

I've attached [this TFLite file](https://github.com/google/iree/files/8298526/ssd_mobilenet_v1_coco_nms.tflite.zip) that includes these ops. When running `iree-import-tflite`, I get the error below:

```
error: The following illegal operations still remain:
tfl.non_max_suppression_v4 (count: 90)
tfl.topk_v2 (count: 2)
tfl.sum (count: 1)
tfl.select (count: 1)
```

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.