Regenerating job definition via job dsl clears state

When ever we make a change to our git repo which contains all the job DSL definitions, and push, all the jobs get recreated, and then on the next run of our job which uses the parallel test executor plugin, instead of running the usual 4 executors job, it only run 1 - as if it loses the state it had regarding the duration of each test.
Since we generate it quite often it quite ruins the effect of using the parallel test executor plugin.