llvm / llvm/llvm-project

mlgo AOT: multi-model support for the same policy

Open
#199,043 0 comments 1 reaction 0 assignees View on GitHub
mlgo
Dominant language
LLVM
Stars
40.5k
Forks
18.7k
PR merge metrics
PR metrics pending

Description

Support for embedding multiple models for the same optimization, and selecting between them with a compile-time flag. For example, we have an arm 32 and an arm 64 size-inliner in chrome. To LLVM, it appears as if there's only one model and the MLInlineAdvisor code is unchanged - except for passing an additional feature to this model, indicating which sub-model to use.

The exact design (extra feature) is perhaps an artifact of how this was implemented in Tensorflow. With EmitC-based AOT, this can be perhaps implemented more elegantly.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.