OpenNMT / OpenNMT/CTranslate2

Can I convert a ctranslate2 model to onnx?

Open
#1,773 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
4.7k
Forks
536
Avg merge
12h 12m
Merged PRs (30d)
4

Description

Hi, I'm new to ctranslate2 here. I needed a faster implementation of whisper on onnx. Can the optimizations done in ctranslate2 be translated to frameworks like onnx, or is it only replicable using the ctranslate2 engine?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named. First clarify whether this is a request for ONNX conversion support or a question about interoperability, then identify the relevant model-conversion or inference documentation and define the supported outcome.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
18/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.