fsspec / fsspec/filesystem_spec
Consider caching python packages to speed up CI
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 490
- Avg merge
- 2d 3h
- Merged PRs (30d)
- 38
Description
I recently noticed that when I developing fsspec, the test step of Github actions were running very slow then locally. After dig into logs, I think a lot of time is consumed in the process of installing python packages: about 8 mins of installing v.s. 3 mins of testing. I tried to cache them but failed because I'm not familiar with tox and miniconda. It would be great if someone could accomplish this.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by inspecting the repository's GitHub Actions configuration and how tox and miniconda install dependencies during the test step. The work is done when dependency caching reduces repeated package-install time without breaking the existing test workflow; run the CI tests to verify it.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- github-actions, python
- Domain
- ci-cd, devops
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100