microsoft / microsoft/onnxruntime

[Feature Request] Inquiry About ONNX Runtime Support for Dynamic Decoding Correction in Machine Translation on Android

Open
#23,216 0 comments 0 reactions 0 assignees View on GitHub
feature request platform:mobile
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

Dear ONNX Runtime Maintainers,

Merry Christmas and Happy New Year to you!

I am planning to develop a machine translation product based on the T5 model, which will be deployed on Android devices. However, there is a specific feature that I am unsure if ONNX Runtime currently supports, and I would greatly appreciate your guidance on this matter.

During machine translation, due to the limitations of the model size, users sometimes find that certain tokens in the target language are not translated correctly. In such cases, users may input the correct target token themselves. At this point, I would like the model to re-decode the subsequent part of the sequence starting from where the user made the correction (assuming that all content before this token position has been translated correctly).

This requirement calls for a rather flexible functionality, and I am uncertain whether the current version of ONNX Runtime can support such an operation. If it does, could you please provide me with an API or, even better, an example? Your assistance would be immensely appreciated.

Thank you very much for your time and help.

### Describe scenario use case

Dynamic Decoding Correction in Machine Translation on Android.

Contributor guide

Open the contributing guide

Research direction

The request names ONNX Runtime, T5, Android, and dynamic decoding correction but no files or tests. Start by reviewing the Android and sequence-decoding capabilities relevant to this workflow; done means a clear support decision with an API or example if the feature is available.

Written by the indexing model from the issue text.

Assessment

Tech stack
android, machine-learning
Domain
machine-learning, mobile-dev
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.