NVIDIA-Merlin / NVIDIA-Merlin/Transformers4Rec
POC with an ANN engine integrated with Transformers4Rec within Triton
Open
Nobody has claimed this yet.
area/inference
scalability
- Dominant language
- Python
- Stars
- 1.3k
- Forks
- 165
- Avg merge
- 1m
- Merged PRs (30d)
- 2
Description
POC with an ANN engine (Milvus / FAISS) integrated with Transformers4Rec within Triton (based on Karl example)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the referenced Karl example and reviewing how Transformers4Rec is intended to run within Triton. Compare the Milvus and FAISS options, then define the POC's integration boundary and validation criteria; done means one ANN engine works with Transformers4Rec within Triton.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- backend-api-design, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100