Initial pulls block Caddy start

When one has more apps using caddy-git, then restarting Caddy leads to long down-time, because the middleware blocks the start until it pulls all the repositories, one by one. Also pulls get slower and slower over time, because it doesn't handle .ssh/known-hosts correctly (as I reported earlier). Anyway, is there a way to make Caddy start fully before the pulling begins? Also, during reload it could be nice, if the pulls are not initiated unless git configuration was changed.