huggingface / huggingface/trl

Replace torch image by vllm image in Docker

Open
#4,523 3 comments 0 reactions 0 assignees View on GitHub
🏋 GRPO 📱 cli
Dominant language
Python
Stars
19.3k
Forks
3k
Avg merge
1d 20h
Merged PRs (30d)
194

Description

> Note that if we want to use `vllm` in the images for e.g. GRPO, a better approach is to use the official vllm image like this:
>
> ```suggestion
> FROM vllm/vllm-openai:v0.10.2
> ```

_Originally posted by @lewtun in [#4522](https://github.com/huggingface/trl/pull/4522/files#r2523945092)_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.