InternLM / InternLM/InternLM-Math
critic model on multiple goals
- Dominant language
- Python
- Stars
- 550
- Forks
- 39
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
I am trying to reproduce the proof search using the critic model. May I check If the current state has multiple goals, then how do we use the critic model evaluate it?
1. just join all the goals together as a single state (prompt) and send it into the critic model to get a single score.
2. for each goal get a score from the critic model individually and add them together.
3. just evaluate the current goal we are trying to solve.
Many thanks for your help in advance!
efessas
Contributor guide
No contributing guide indexed for this repository
Research direction
No files, tests, or entry points are named. First confirm how the proof-search implementation represents multiple goals and whether the critic model behavior is documented elsewhere. Done means recording a maintainer-confirmed rule for evaluating multi-goal states, rather than choosing among the three options without project context.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100