tensorflow / tensorflow/tflite-support

Problem loading Yolo Version 11 on Android Studio using Interpreter api and GPU delegate

Open
#997 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
441
Forks
146
PR merge metrics
No merged PRs in 30d

Description

I have converted a YoloV11 model using Ultralytics' export function into a .tflite format. I then attempted to load the interpreter using Interpreter(model, options). The options had a GPU delegate set:

        val delegate = GpuDelegate()
     
        val options = Interpreter.Options().addDelegate(delegate)
      
        interpreter = Interpreter(model, options)

This DID NOT work for YoloV11 but DID work for Yolov8, which I converted the exact same way. I also attempted to convert to onnx and then tflite, but the Interpreter(model, options) would also stall (just never finish) for yolov11. I believe this might be due to unsupported operations, and have looked at Netron, but it is quite tedious.

I would like to know if this is a known issue and if there is a fix. Here is some additional context:

  1. I attempted to just use the CPU for my YoloV11 using options.numThreads(4) instead of the delegate code above. It worked just fine.

  2. I attempted to use the GPU for YoloV8 which was converted the exact same way, it worked without issue.

  3. compatList.isDelegateSupportedOnThisDevice somehow returns false no matter which model I am loading, but this doesn't seem to stop my V8 model from loading and running.

  4. I am running a demensity chip on my device.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the Android Interpreter API load with the reported YOLOv11 .tflite model, GPU delegate, and CPU fallback, then compare it with the working YOLOv8 conversion. Inspect the model in Netron and check GPU delegate operation support; done means identifying the unsupported operation or conversion difference and documenting a confirmed fix or limitation.

Written by the indexing model from the issue text.

Assessment

Tech stack
android, tensorflow
Domain
machine-learning, mobile-dev
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.