alibaba / alibaba/RecIS

Recommended model architecture/parameter settings to emulate real-world workload?

Open
#5 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
356
Forks
25
PR merge metrics
No merged PRs in 30d

Description

Many thanks for the great work!

1) Recommendation system is a very import application in AI. I was wondering if there is set of recommended settings (e.g. the scales of data, embedding table sizes, feature interaction architecture etc.) to emulate a production-level recsys inference/training, so we can understand what the exact workload is like?

2) Besides, what sort of hardware are best suited for inference or training, CPUs and/or GPUs? I'm very curious what each component in a recsys is like, which part is memory/compute/communication bound? What parallelizing methods (TP, DP, mixed butterfly etc) are employed?

3) Additionally, if a recsys is combined with LLMs (or it is LLM architecture), how do they interact, does RecIS support it?

Kind regards

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points to investigate. It asks for production recommendation-system configurations, hardware and parallelization guidance, and possible LLM integration, so a contributor would first need to define the supported scope and success criteria with maintainers.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.