agentscope-ai / agentscope-ai/Trinity-RFT

[FEATURE] Recommended way of producing multiple Experiences in multi-turn dialogs

Ouverte
#269 1 commentaire 0 réactions 0 personnes assignées Voir sur GitHub
enhancement
Langage dominant
Python
Étoiles
701
Forks
79
Merge moyen
8 h 7 min
PR mergées (30 j)
1

Description

Imagine a two-turn dialog:
1. system prompt
2. first user prompt
3. first assistant response
4. second user prompt
5. final assistant response

One could represent it as Experience by concatenating everything and masking everything except two assistant responses

Another way could be splitting it into two experiences.
The first one:
1. system prompt
2. first user prompt
3. first assistant response (masked as target assistant)

The second one:
1. system prompt
2. first user prompt
3. first assistant response
4. second user prompt
5. final assistant response (masked as target assistant)

Is this other multi-experience way recommended? If so, how to best produce it?

E.g. should a `run()` method return these several experiences, right?

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.