scrapinghub / scrapinghub/python-scrapinghub
Zyte Job API: Provision to support Cron Expression or Time Interval
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 205
- Forks
- 62
- PR merge metrics
- No merged PRs in 30d
Description
Hello Contributors,
I have a query regarding Job API I noticed there is no provision to schedule periodic jobs given a cron expression or time interval.
The only way to schedule a periodic job requires manual effort: https://support.zyte.com/support/solutions/articles/22000200419-scheduling-periodic-jobs.
Is there any way to perform this using Job API or should this be considered as a new feature request? Please let me know your thoughts.
Thanks
References:
https://support.zyte.com/support/solutions/articles/22000200419-scheduling-periodic-jobs
https://docs.zyte.com/scrapy-cloud/usage/reference/http/jobs.html
https://github.com/scrapinghub/python-scrapinghub/issues/113#issuecomment-466294136
https://github.com/scrapinghub/python-scrapinghub/issues/113#issuecomment-2235770682
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the linked Job API documentation and the referenced support article to understand the current scheduling workflow. Review the related python-scrapinghub issue and comments for prior discussion. Done should be defined as an agreed Job API approach for cron expressions or time intervals, with the client behavior and documentation requirements identified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100