random_startup_delay affects all jobs, not just initial minion service startup

Description of Issue/Question

Windows minion applies random_startup_delay configuration value to jobs executed by the master.

The maximum bound for an interval in which a minion will randomly sleep upon starting up prior to attempting to connect to a master. This can be used to splay connection attempts for cases where many minions starting up at once may place undue load on a master.

Setup

Minion config:
log_level: debug
log_level_logfile: debug
random_startup_delay: 120

Steps to Reproduce Issue

Run salt '*' test.ping multiple times on the master

Actual Outcome:

• Each test.ping will sleep for a random interval between 0 and [random-startup-delay] before executing.
• If the sleep interval is longer than the , the master reports "Minion did not return. [No response]"

Expected Outcome:

• random_startup_delay applies only to minion service startup, imparting a random delay on initialization of authentication and scheduling.
• random_startup_delay should not apply to startup of every job individually.
• Jobs invoked from the master should start immediately.

2017-11-20 13:16:40,861 [salt.minion      ][INFO    ][12236] User sudo_opsadmin Executing command test.ping with jid 20171120131640805325
2017-11-20 13:16:40,861 [salt.minion      ][DEBUG   ][12236] Command details {'tgt_type': 'glob', 'jid': '20171120131640805325', 'tgt': 'xMinion_IDx', 'ret': '', 'user': 'sudo_opsadmin', 'arg': [], 'fun': 'test.ping'}
2017-11-20 13:16:42,392 [salt.log.setup   ][DEBUG   ][9220] Multiprocessing queue logging configured for the process running under PID: 9220
2017-11-20 13:16:42,392 [salt.config      ][DEBUG   ][9220] Reading configuration from c:\salt\conf\minion
2017-11-20 13:16:42,456 [salt.config      ][DEBUG   ][9220] Including configuration from 'c:\salt\conf\minion.d\_schedule.conf'
2017-11-20 13:16:42,456 [salt.config      ][DEBUG   ][9220] Reading configuration from c:\salt\conf\minion.d\_schedule.conf
2017-11-20 13:16:42,456 [salt.config      ][DEBUG   ][9220] Including configuration from 'c:\salt\conf\minion.d\keepalive.conf'
2017-11-20 13:16:42,456 [salt.config      ][DEBUG   ][9220] Reading configuration from c:\salt\conf\minion.d\keepalive.conf
2017-11-20 13:16:42,456 [salt.config      ][DEBUG   ][9220] Including configuration from 'c:\salt\conf\minion.d\loglevel.conf'
2017-11-20 13:16:42,456 [salt.config      ][DEBUG   ][9220] Reading configuration from c:\salt\conf\minion.d\loglevel.conf
2017-11-20 13:16:42,456 [salt.config      ][DEBUG   ][9220] Including configuration from 'c:\salt\conf\minion.d\startupdelay.conf'
2017-11-20 13:16:42,456 [salt.config      ][DEBUG   ][9220] Reading configuration from c:\salt\conf\minion.d\startupdelay.conf
2017-11-20 13:16:42,456 [salt.config      ][DEBUG   ][9220] Including configuration from 'c:\salt\conf\minion.d\transport.conf'
2017-11-20 13:16:42,456 [salt.config      ][DEBUG   ][9220] Reading configuration from c:\salt\conf\minion.d\transport.conf
2017-11-20 13:16:44,517 [salt.minion      ][INFO    ][9220] Creating minion process manager
2017-11-20 13:16:44,517 [salt.minion      ][INFO    ][9220] Minion sleeping for 87 seconds due to configured startup_delay between 0 and 120 seconds
2017-11-20 13:16:45,878 [salt.minion      ][INFO    ][12236] User sudo_opsadmin Executing command saltutil.find_job with jid 20171120131645829791
2017-11-20 13:16:45,878 [salt.minion      ][DEBUG   ][12236] Command details {'tgt_type': 'list', 'jid': '20171120131645829791', 'tgt': ['xMinion_IDx'], 'ret': '', 'user': 'sudo_opsadmin', 'arg': ['20171120131640805325'], 'fun': 'saltutil.find_job'}
2017-11-20 13:16:47,253 [salt.log.setup   ][DEBUG   ][13936] Multiprocessing queue logging configured for the process running under PID: 13936
2017-11-20 13:16:47,253 [salt.config      ][DEBUG   ][13936] Reading configuration from c:\salt\conf\minion
2017-11-20 13:16:47,299 [salt.config      ][DEBUG   ][13936] Including configuration from 'c:\salt\conf\minion.d\_schedule.conf'
2017-11-20 13:16:47,299 [salt.config      ][DEBUG   ][13936] Reading configuration from c:\salt\conf\minion.d\_schedule.conf
2017-11-20 13:16:47,299 [salt.config      ][DEBUG   ][13936] Including configuration from 'c:\salt\conf\minion.d\keepalive.conf'
2017-11-20 13:16:47,299 [salt.config      ][DEBUG   ][13936] Reading configuration from c:\salt\conf\minion.d\keepalive.conf
2017-11-20 13:16:47,299 [salt.config      ][DEBUG   ][13936] Including configuration from 'c:\salt\conf\minion.d\loglevel.conf'
2017-11-20 13:16:47,299 [salt.config      ][DEBUG   ][13936] Reading configuration from c:\salt\conf\minion.d\loglevel.conf
2017-11-20 13:16:47,299 [salt.config      ][DEBUG   ][13936] Including configuration from 'c:\salt\conf\minion.d\startupdelay.conf'
2017-11-20 13:16:47,299 [salt.config      ][DEBUG   ][13936] Reading configuration from c:\salt\conf\minion.d\startupdelay.conf
2017-11-20 13:16:47,315 [salt.config      ][DEBUG   ][13936] Including configuration from 'c:\salt\conf\minion.d\transport.conf'
2017-11-20 13:16:47,315 [salt.config      ][DEBUG   ][13936] Reading configuration from c:\salt\conf\minion.d\transport.conf
2017-11-20 13:16:48,065 [salt.minion      ][INFO    ][13936] Creating minion process manager
2017-11-20 13:16:48,065 [salt.minion      ][INFO    ][13936] Minion sleeping for 71 seconds due to configured startup_delay between 0 and 120 seconds
2017-11-20 13:17:59,082 [salt.minion      ][INFO    ][13936] Starting a new job with PID 13936
2017-11-20 13:17:59,115 [salt.utils.lazy  ][DEBUG   ][13936] LazyLoaded saltutil.find_job
2017-11-20 13:17:59,115 [salt.utils.lazy  ][DEBUG   ][13936] LazyLoaded direct_call.get
2017-11-20 13:17:59,115 [salt.minion      ][DEBUG   ][13936] Minion return retry timer set to 7 seconds (randomized)
2017-11-20 13:17:59,115 [salt.minion      ][INFO    ][13936] Returning information for job: 20171120131645829791

Versions Report

Master

Salt Version:
           Salt: 2017.7.2

Dependency Versions:
           cffi: Not Installed
       cherrypy: Not Installed
       dateutil: 2.4.2
      docker-py: Not Installed
          gitdb: 0.6.4
      gitpython: 1.0.1
          ioflo: Not Installed
         Jinja2: 2.8
        libgit2: Not Installed
        libnacl: Not Installed
       M2Crypto: Not Installed
           Mako: 1.0.3
   msgpack-pure: Not Installed
 msgpack-python: 0.4.6
   mysql-python: Not Installed
      pycparser: Not Installed
       pycrypto: 2.6.1
   pycryptodome: Not Installed
         pygit2: Not Installed
         Python: 2.7.12 (default, Nov 19 2016, 06:48:10)
   python-gnupg: Not Installed
         PyYAML: 3.11
          PyZMQ: 15.2.0
           RAET: Not Installed
          smmap: 0.9.0
        timelib: Not Installed
        Tornado: 4.2.1
            ZMQ: 4.1.4

System Versions:
           dist: Ubuntu 16.04 xenial
         locale: UTF-8
        machine: x86_64
        release: 4.4.0-98-generic
         system: Linux
        version: Ubuntu 16.04 xenial

Minion

    Salt Version:
               Salt: 2017.7.2

    Dependency Versions:
               cffi: 1.10.0
           cherrypy: 10.2.1
           dateutil: 2.6.0
          docker-py: Not Installed
              gitdb: 2.0.3
          gitpython: 2.1.3
              ioflo: Not Installed
             Jinja2: 2.9.6
            libgit2: Not Installed
            libnacl: Not Installed
           M2Crypto: Not Installed
               Mako: 1.0.6
       msgpack-pure: Not Installed
     msgpack-python: 0.4.8
       mysql-python: Not Installed
          pycparser: 2.17
           pycrypto: 2.6.1
       pycryptodome: Not Installed
             pygit2: Not Installed
             Python: 2.7.13 (v2.7.13:a06454b1afa1, Dec 17 2016, 20:53:40) [MSC v.1500 64 bit (AMD64)]
       python-gnupg: 0.4.0
             PyYAML: 3.11
              PyZMQ: 16.0.2
               RAET: Not Installed
              smmap: 2.0.3
            timelib: 0.2.4
            Tornado: 4.5.1
                ZMQ: 4.1.6

    System Versions:
               dist:
             locale: cp1252
            machine: AMD64
            release: 2012ServerR2
             system: Windows
            version: 2012ServerR2 6.3.9600  Multiprocessor Free

Reproduce the Windows minion behavior with random_startup_delay: 120, then run repeated test.ping and saltutil.find_job commands while reviewing the minion startup and job execution paths. Done means the configured delay occurs only during minion service startup, while jobs invoked from the master begin immediately without sleeping.