adithya-s-k / adithya-s-k/CompanionLLM

Implement Full Weights Fine-Tuning Using Axalotal

未关闭
#8 0 条评论 0 个 reaction 已指派 1 人 已被 @adithya-s-k 认领 在 GitHub 查看
hacktoberfest hacktoberfest-accepted
主要语言
Jupyter Notebook
星标
54
派生
4
PR 合并指标
30 天内没有已合并 PR

描述

## Description
Implement full weights fine-tuning of the CompanionLLama model using the [Axalotal](https://github.com/OpenAccess-AI-Collective/axolotl) framework. This will help enhance the model's performance and adapt it to specific tasks or domains.

## Tasks
- [ ] Research and explore the Axalotal framework for fine-tuning language models.
- [ ] Develop a workflow for implementing full weights fine-tuning using Axalotal.
- [ ] Execute the fine-tuning process on the CompanionLLama model.
- [ ] Assess the impact of full weights fine-tuning on the model's responses and capabilities.
- [ ] Document the fine-tuning process and outcomes.
- [ ] Update the README to provide information on Axalotal-based fine-tuning.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。