agentscope-ai / agentscope-ai/Trinity-RFT

[FEATURE] Recommended way of producing multiple Experiences in multi-turn dialogs

Aberta
#269 1 comentário 0 reações 0 responsáveis Ver no GitHub
enhancement
Linguagem predominante
Python
Estrelas
701
Forks
79
Merge médio
8h 7min
PRs com merge (30d)
1

Descrição

Imagine a two-turn dialog:
1. system prompt
2. first user prompt
3. first assistant response
4. second user prompt
5. final assistant response

One could represent it as Experience by concatenating everything and masking everything except two assistant responses

Another way could be splitting it into two experiences.
The first one:
1. system prompt
2. first user prompt
3. first assistant response (masked as target assistant)

The second one:
1. system prompt
2. first user prompt
3. first assistant response
4. second user prompt
5. final assistant response (masked as target assistant)

Is this other multi-experience way recommended? If so, how to best produce it?

E.g. should a `run()` method return these several experiences, right?

Guia de contribuição

Abrir o guia de contribuição

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.