agentscope-ai / agentscope-ai/Trinity-RFT

[FEATURE] Recommended way of producing multiple Experiences in multi-turn dialogs

Abierto
#269 1 comentario 0 reacciones 0 asignados Ver en GitHub
enhancement
Lenguaje dominante
Python
Estrellas
701
Forks
79
Merge medio
8 h 7 min
PR fusionados (30 d)
1

Descripción

Imagine a two-turn dialog:
1. system prompt
2. first user prompt
3. first assistant response
4. second user prompt
5. final assistant response

One could represent it as Experience by concatenating everything and masking everything except two assistant responses

Another way could be splitting it into two experiences.
The first one:
1. system prompt
2. first user prompt
3. first assistant response (masked as target assistant)

The second one:
1. system prompt
2. first user prompt
3. first assistant response
4. second user prompt
5. final assistant response (masked as target assistant)

Is this other multi-experience way recommended? If so, how to best produce it?

E.g. should a `run()` method return these several experiences, right?

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.