a16z-infra / a16z-infra/llama2-chatbot
It seems that, "Assistant: " will be appended to the end of prompt twice?
未关闭
- 主要语言
- Python
- 星标
- 1.4k
- 派生
- 219
- PR 合并指标
- 30 天内没有已合并 PR
描述
https://github.com/a16z-infra/llama2-chatbot/blob/main/llama2_chatbot.py#L169C1-L170C1
output = debounce_replicate_run(st.session_state['llm'], string_dialogue + **"Assistant: "**, st.session_state['max_seq_len'], st.session_state['temperature'], st.session_state['top_p'], REPLICATE_API_TOKEN)
https://github.com/a16z-infra/llama2-chatbot/blob/main/utils.py#L27
output = replicate.run(llm, input={"prompt": prompt + **"Assistant: "**, "max_length": max_len, "temperature": temperature, "top_p": top_p, "repetition_penalty": 1}, api_token=API_TOKEN)
It seems that, "Assistant: " will be appended to the end of prompt twice?
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。