THUDM / THUDM/slime

[Question] 是否支持终端任务的RL训练(类似Terminal Bench)

Open
#1,644 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

question
Dominant language
Python
Stars
8.5k
Forks
1.3k
Avg merge
5h 36m
Merged PRs (30d)
22

Description

Your Question

Does this framework currently support (or have plans to support) Reinforcement Learning training for terminal-based interactive tasks?

Specifically, I am interested in environments similar to Terminal Bench, where the agent needs to:

Interact with a bash shell or CLI tools.

Handle multi-step decision-making based on terminal outputs.

Learn from rewards derived from task completion (e.g., successful file manipulation or system configuration).

Given the current search-r1 and slime-mmq examples, is there a recommended way to wrap a terminal environment for training within this repository?

What I've Tried

Only read the Quick Start Guide but not found

Environment (if relevant)
  • slime version:
  • Python version:
  • PyTorch version:
  • CUDA/ROCm version:
  • GPU type and count:
  • OS:
Additional Context

No response

Pre-submission Checklist

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the Quick Start Guide, the search-r1 and slime-mmq examples, and the linked documentation and FAQ. Determine whether they expose an existing way to wrap interactive terminal tasks; done would require a maintainer-confirmed support path or a documented plan for adding one.

Written by the indexing model from the issue text.

Assessment

Tech stack
bash, python
Domain
cli, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.