微调时报错，FileNotFoundError: No such file or directory: './sft_data/train.jsonl'
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 12.3k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
微调时提示将数据集按照 conversation_without_plugins格式处理并放到 sft_data 目录中，我自己没有数据集，所以直接将run.sh里面的--data_dir ./sft_data \改为了--data_dir ./SFT_data/conversations/conversation_without_plugins/harmless_conversations \，但是仍然报错FileNotFoundError: [Errno 2] No such file or directory: './SFT_data/conversations/conversation_without_plugins/harmless_conversations/train.jsonl'
请问为啥自动加了train.jsonl？如何修改
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with run.sh and trace the --data_dir argument into the fine-tuning data-loading entry point. Check why train.jsonl is appended and compare that expectation with the harmless_conversations directory; done means documenting or correcting the supported data path and reproducing fine-tuning without FileNotFoundError.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100