InternLM / InternLM/HuixiangDou

关于本地部署的一些问题

Open
#196 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.5k
Forks
179
PR merge metrics
No merged PRs in 30d

Description

尊敬的茴香豆开发人员您好,我在学习研究项目时有以下问题仍然有点困惑请求解答:
1. web search超出免费限额的费用标准? 是否可以关闭web search功能?
2. 本地部署支持的llm种类以及服务框架(fastchat?vllm?lmdeploy?)?是否支持自己微调后的模型?
3. 本地单卡部署茴香豆,llm为finetune后internlm2-chat-20b,推荐显卡配置?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.