mozilla-releng / mozilla-releng/scriptworker
revisit `context.projects`
@jcristau is already working on this.
Since Sep 14, 2022.
- Dominant language
- Python
- Stars
- 5
- Forks
- 39
- Avg merge
- 4h 18m
- Merged PRs (30d)
- 6
Description
Aiui, we:
- updated autoland's scm level
- started failing cot because
context.projectsis cached over the lifetime of a running scriptworker. We couldawait context.populate_projects(force=True), but we never call that from anywhere in the code.
One potential solution here is:
- add a timestamp for when we populate
context.projects, e.g.context._projects_timestamp. We should update this on the projects setter. - add a config item for how long to cache
context.projectsifforce=False. - if we're past the TTL of the cache, update
context.projectseven ifforce=False.
Also this:
09:28 < aki> are there any outstanding cot questions? or all resolved
09:30 < tomprince> aki: All resolved, I think. I think we should consider making scriptworker use ci-admin to get the repository level, rather than having it understand the config format directly.
09:30 < aki> ok
09:30 < tomprince> aki: https://hg.mozilla.org/ci/ci-configuration/rev/745b0dce17f8 is what caused the breakage, I think.
09:33 < jlorenzo> sounds like a good fix
09:34 < aki> it's a lot more heavy weight than downloading a file, but it's doable. could we have ci-{configuration,admin} automation generate an artifact that scriptworker consumes?
09:35 < aki> that would avoid having to clone ci-{configuration,admin} everywhere we want to verify cot. i imagine we'll want to add cot verification to all artifact downloads in the graph at some point
This is the first time I know of that we've hit this issue, so this might not be super urgent. Good to address though.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.