microsoft / microsoft/onnxruntime

How OnnxRuntime C# API can address the pain points of ~900 ML.NET Apr2021 survey responses?

Open
#8,345 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

api feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 8h
Merged PRs (30d)
179

Description

Is your feature request related to a problem? Please describe.

The pain points of the Apr 2021 ML.NET survey and the result discussions

Describe the solution you'd like

It is clear that NLP is high on priority
This means **more deep learning NLP use cases ** e.g. using ML.NET or just ONNX C# API to load pretrained Hugging Face transformer models using OnnxRuntime

With recent renaming effort to make TorchSharp more PyTorch like, it is NOW more feasible to port the PyTorch NLP Transformer codes [The ONNX API inference session] to .NET (c# or f#)

Here are some of the PyTorch NLP Transformer code candidates (porting to c#) to address the pain points of ML.NET!!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with Inference_GPT2_with_OnnxRuntime_on_CPU.ipynb and Inference_GPT2-OneStepSearch_OnnxRuntime_CPU.ipynb to understand the proposed transformer inference flows and compare them with the OnnxRuntime C# API. Done would require a concrete, validated scope for porting one of these NLP use cases to C#, rather than the broad survey-driven request currently provided.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp, huggingface, pytorch
Domain
ai, api, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.