InternLM / InternLM/InternLM-Math

About augmentation with Change specific numbers.

Open
#9 1 comment 0 reactions 0 assignees View on GitHub
wontfix
Dominant language
Python
Stars
550
Forks
39
PR merge metrics
No merged PRs in 30d

Description

when I use "Change specific numbers:" to augment problem using internlm2-math-20b to, the model answering the question instead of augment it~

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("internLLMATH", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("internLLMATH", trust_remote_code=True, torch_dtype=torch.float16).cuda()
model = model.eval()
response, history = model.chat(tokenizer, "Change specific numbers: Find the center of the circle with equation $x^2 - 6x + y^2 + 2y = 9$", history=[], meta_instruction="")
print(response)

We complete the square for both $x$ and $y$ terms. For the $x$ terms, we add $(6/2)^2 = 9$ to both sides. For the $y$ terms, we add $(2/2)^2 = 1$ to both sides. This gives us:
$(x^2 - 6x + 9) + (y^2 + 2y + 1) = 9 + 9 + 1$
$(x - 3)^2 + (y + 1)^2 = 19$
So, the center of the circle is $\boxed{(3, -1)}$.
The answer is: (3,-1).

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the behavior with the provided Python script and the model.chat call using the "Change specific numbers:" prompt. Inspect the model's augmentation behavior and determine what distinguishes augmentation from answering; done means this prompt changes the problem's numbers instead of returning a solved response.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.