huggingface / huggingface/blog

Can we use a model GPT or RoBERTa to train on less than 10mb or 100 kb file to generate poem, chat, or group of text?

Open
#19 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
3.5k
Forks
1k
Avg merge
1d 20h
Merged PRs (30d)
19

Description

I have seeming people do this in GPT, such as on Shakespeare's poem, but I don't know how to train it and load the pre-train with hugging face. Any suggestions on how and which model to pick?
Thank You🤗

I don't see it on the doc, blog, or notebooks.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue mentions Hugging Face pretrained models and the project's docs, blog posts, and notebooks, but names no file or entry point. Start by reviewing those resources for existing guidance; done would require a defined documentation or notebook change, which the issue does not specify.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, jupyter-notebook
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.