AIAnytime / AIAnytime/ORPO-Mistral-7B-Alignment
config.json file not loaded
未关闭
- 主要语言
- Jupyter Notebook
- 星标
- 4
- 派生
- 2
- PR 合并指标
- 30 天内没有已合并 PR
描述
tried
```
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("Andyrasika/Mistral7b-ORPO")
tokenizer = AutoTokenizer.from_pretrained("Andyrasika/Mistral7b-ORPO")
# Apply chat template
query = [{'role': 'user', 'content': 'Hi! How are you doing?'}]
prompt = tokenizer.apply_chat_template(query, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors='pt')
# Generation with specific configurations
output = model.generate(
**inputs,
max_new_tokens=128,
do_sample=True,
temperature=0.7
)
response = tokenizer.batch_decode(output)
```
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。