EpistasisLab / EpistasisLab/tpot2
Population class logging is inefficient and needs to be optimized.
- Dominant language
- Jupyter Notebook
- Stars
- 250
- Forks
- 33
- PR merge metrics
- No merged PRs in 30d
Description
The population class stores its logs in a pandas data frame. This has very slow appends, which get slower the more items are in the data frame. This becomes a bigger issue with long running evolutions or evolutions with short evaluation times that can iterate through individuals quickly. For example, Tutorial 8 becomes noticeably slower as it progresses.
Also related: Pandas 2.0.0 breaks some code in the Population class. Currently, it only supports 1.5.3
The Population class needs to be optimized with a better underlying data structure. Perhaps an SQL structure? Or a dictionary of dictionaries?
I think using a pandas data frame with preallocation would not be ideal.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.