OpenNMT / OpenNMT/CTranslate2

Support for CodeT5pConfig

Open
#1,229 1 comment 10 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
C++
Stars
4.7k
Forks
536
Avg merge
12h 12m
Merged PRs (30d)
4

Description

A new family of Salesforce coding models has been released
https://huggingface.co/Salesforce/codet5p-2b/

Context:
CodeT5+ is a new family of open code large language models with an encoder-decoder architecture that can flexibly operate in different modes (i.e. encoder-only, decoder-only, and encoder-decoder) to support a wide range of code understanding and generation tasks. It is introduced in the paper:

Log:

ValueError: No conversion is registered for the model configuration CodeT5pConfig (
supported configurations are: 
    BartConfig, MarianConfig, M2M100Config, MBartConfig, PegasusConfig, OPTConfig, GPT2Config,
    GPTJConfig, GPTNeoXConfig, WhisperConfig, T5Config, MT5Config, BloomConfig
)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the model-conversion registry that reports CodeT5pConfig as unsupported, then inspect how the listed configuration types are handled. Done means CodeT5pConfig is accepted for the Salesforce CodeT5+ models instead of raising the reported ValueError; verify this with the repository's relevant conversion checks.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.