Runtime: large discrepency between step time and operation time?
Open
@josephjclark is already working on this.
Since Feb 20, 2025.
DevX
- Dominant language
- TypeScript
- Stars
- 21
- Forks
- 23
- Avg merge
- 1d 22h
- Merged PRs (30d)
- 17
Description
Eagle-eyed Taylor Downs has spotted a really interesting timing discrepancy within the runtime.
Note that that this is in the runtime logs, so we can discount all the worker eventing and spin up stuff.
R/T Starting step Map Data
R/T [linker] loading module @openfn/language-common
R/T [linker] Loading module @openfn/language-common from /tmp/openfn/worker/repo/node_modules/@openfn/language-common_2.3.0/dist/index.cjs
R/T Resolved adaptor @openfn/language-common to version 2.3.0
R/T Executing expression (1 operations)
R/T Starting operation 1
R/T Operation 1 complete in 1ms
R/T Expression complete!
R/T Map Data completed in 464msms
Specifically this:
R/T Operation 1 complete in 1ms
R/T Map Data completed in 464msms
User code only took 1ms, but the whole step took 464? Why?
Questions:
- Can we reproduce this locally?
- What is taking the time to execute a step, if not the the actual operations?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.