cloudflare / cloudflare/cloudflare-docs

Fine Tune Models with Autotrain (LoRA) tutorial is out of date

Open
#20,395 3 comments 0 reactions 3 assignees Assigned to @rita3ko View on GitHub
content:edit documentation product:workers-ai stale
Dominant language
MDX
Stars
5.2k
Forks
16.7k
Avg merge
2d 6h
Merged PRs (30d)
337

Description

### Existing documentation URL(s)

https://developers.cloudflare.com/workers-ai/tutorials/fine-tune-models-with-autotrain/

### What changes are you suggesting?

The [Google Colab notebook](https://colab.research.google.com/github/huggingface/autotrain-advanced/blob/main/colabs/AutoTrain_LLM.ipynb) used in the tutorial appears to no longer output the expected artifacts (`adapter_config.json` and `adapter_model.safetensors`) rendering it useless for lora training on Cloudflare.

### Additional information

This was tested using both `meta-llama/llama-2-7b-chat-hf` and `cf/meta-llama/llama-2-7b-chat-hf-lora`. No `adapter_model.safetensors` or `adapter_config.json` file was generated.

Image

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.