Model file extremely large, saved using pickle
Open
Nobody has claimed this yet.
- Dominant language
- Jupyter Notebook
- Stars
- 4.8k
- Forks
- 827
- PR merge metrics
- No merged PRs in 30d
Description
Not sure if anyone else has come across this problem. I used pickle to save model file and the resulting file is over 20G.
My dataset has around 600K records, 100 features in W, 4 features in X
Is this supposed to be this big? What is the reason of such large model file?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points. Start by reproducing the reported pickle serialization with the described dataset and model configuration, then inspect which model components or stored data account for the file size. Done means explaining the cause and identifying a supported way to avoid unnecessary growth.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100