agentscope-ai / agentscope-ai/Trinity-RFT

[FEATURE] Recommended way of producing multiple Experiences in multi-turn dialogs

Open
#269 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
701
Forks
79
Avg merge
8h 7m
Merged PRs (30d)
1

Description

Imagine a two-turn dialog:
1. system prompt
2. first user prompt
3. first assistant response
4. second user prompt
5. final assistant response

One could represent it as Experience by concatenating everything and masking everything except two assistant responses

Another way could be splitting it into two experiences.
The first one:
1. system prompt
2. first user prompt
3. first assistant response (masked as target assistant)

The second one:
1. system prompt
2. first user prompt
3. first assistant response
4. second user prompt
5. final assistant response (masked as target assistant)

Is this other multi-experience way recommended? If so, how to best produce it?

E.g. should a `run()` method return these several experiences, right?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.