NVIDIA-Merlin / NVIDIA-Merlin/Merlin

[Task] - Incorporate embeddings (pre-trained and encoder-based) into Merlin Training and Inference

Open
#471 6 comments 0 reactions 2 assignees View on GitHub

@jperez999 is already working on this.

Since Jul 19, 2022.

Dominant language
Python
Stars
907
Forks
129
PR merge metrics
No merged PRs in 30d

Description

Problem:

Two+ customer teams would like to leverage encoder-based embeddings as additional features in Transformers4Rec. Currently, there is no clear example/path to pass in extra embeddings. This gap in feature prevents teams from adopting Transformers4Rec in production.

Goal:

  • Produce a comprehensive example on how to incorporate embeddings as extra features into Transformers4Rec. Embeddings may be stored in parquet format. Generalizations should be made where possible in examples, especially on defining the schema and other input parameters.

Constraints:

  • Embeddings may be stored in parquet files
  • Workflow should be able to be deployed in Triton

Starting Point:

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.