adithya-s-k / adithya-s-k/CompanionLLM
Implement Full Weights Fine-Tuning Using Axalotal
- 主要语言
- Jupyter Notebook
- 星标
- 54
- 派生
- 4
- PR 合并指标
- 30 天内没有已合并 PR
描述
## Description
Implement full weights fine-tuning of the CompanionLLama model using the [Axalotal](https://github.com/OpenAccess-AI-Collective/axolotl) framework. This will help enhance the model's performance and adapt it to specific tasks or domains.
## Tasks
- [ ] Research and explore the Axalotal framework for fine-tuning language models.
- [ ] Develop a workflow for implementing full weights fine-tuning using Axalotal.
- [ ] Execute the fine-tuning process on the CompanionLLama model.
- [ ] Assess the impact of full weights fine-tuning on the model's responses and capabilities.
- [ ] Document the fine-tuning process and outcomes.
- [ ] Update the README to provide information on Axalotal-based fine-tuning.
贡献指南
评估
这个 Issue 还没有评估数据。