davisking / davisking/dlib

Feature: Android NN API usage

Open
#1,332 1 comment 0 reactions 0 assignees View on GitHub
help wanted
Dominant language
C++
Stars
14.4k
Forks
3.4k
PR merge metrics
No merged PRs in 30d

Description

Android now has a neural network API that delegates to NPU/DSP/GPU or falls back to CPU, on devices running Android 8.1 or higher.
https://developer.android.com/ndk/guides/neuralnetworks/

Ideally there would be a backend in dlib to support this framework as it is likely going to be the most optimised pathway going forwards.

NNAPI is a bit limited in what it can do at this stage.
It only does int8, int32 and float32 for types and a few dozen operations.

It was expanded in NNAPI 1.1, adding some more operations [Div/Mul/Pad/Mean/Sub] (which requires Android 9.0).

Example implementation can be found in the Tensorflow Lite library: https://github.com/tensorflow/tensorflow/blob/master/tensorflow/lite/nnapi/NeuralNetworksShim.h

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.