[BUG]Salt request timed out. The master is not responding. You may need to run your command with `--async` in order to bypass the congested event bus. With `--async`, the CLI tool will print the job id (jid) and exit immediately without listening for responses. You can then use `salt-run jobs.lookup_jid` to look up the results of the job in the job cache later.

Issue is appearing on salt-master

Salt Version:
          Salt: 3004.1

Dependency Versions:
          cffi: Not Installed
      cherrypy: Not Installed
      dateutil: Not Installed
     docker-py: Not Installed
         gitdb: Not Installed
     gitpython: Not Installed
        Jinja2: 2.11.1
       libgit2: Not Installed
      M2Crypto: 0.35.2
          Mako: Not Installed
       msgpack: 0.6.2
  msgpack-pure: Not Installed
  mysql-python: 1.3.12
     pycparser: Not Installed
      pycrypto: 2.6.1
  pycryptodome: Not Installed
        pygit2: Not Installed
        Python: 3.6.8 (default, Nov 16 2020, 16:55:22)
  python-gnupg: Not Installed
        PyYAML: 3.13
         PyZMQ: 17.0.0
         smmap: Not Installed
       timelib: Not Installed
       Tornado: 4.5.3
           ZMQ: 4.1.4

System Versions:
          dist: centos 7 Core
        locale: UTF-8
       machine: x86_64
       release: 3.10.0-1160.59.1.el7.x86_64
        system: Linux
       version: CentOS Linux 7 Core

We're targeting around 130 minions and applying some formula which is causing this issue. Can someone recommend tweaking some specific configs or something to help tackle the problem ?

I tried increasing the response timeout but no luck.

sudo salt -C '*' state.apply formulas.ossec.setup_repo -t 20 test=True &> ~/temp.log
All the minions that are being targeted are having versions 3004 / 3004.1 - Nothing less.

    Salt Version:
              Salt: 3004.1

    Dependency Versions:
              cffi: Not Installed
          cherrypy: Not Installed
          dateutil: Not Installed
         docker-py: Not Installed
             gitdb: Not Installed
         gitpython: Not Installed
            Jinja2: 2.11.1
           libgit2: Not Installed
          M2Crypto: 0.35.2
              Mako: Not Installed
           msgpack: 0.6.2
      msgpack-pure: Not Installed
      mysql-python: Not Installed
         pycparser: Not Installed
          pycrypto: Not Installed
      pycryptodome: Not Installed
            pygit2: Not Installed
            Python: 3.6.8 (default, Nov 16 2020, 16:55:22)
      python-gnupg: Not Installed
            PyYAML: 3.13
             PyZMQ: 17.0.0
             smmap: Not Installed
           timelib: Not Installed
           Tornado: 4.5.3
               ZMQ: 4.1.4

    System Versions:
              dist: centos 7 Core
            locale: ANSI_X3.4-1968
           machine: x86_64
           release: 3.10.0-1160.49.1.el7.x86_64
            system: Linux
           version: CentOS Linux 7 Core

Start with the reported salt -C '*' state.apply formulas.ossec.setup_repo -t 20 test=True command and the Salt 3004.1 master/minion details. Investigate the timeout with about 130 targeted minions, focusing on the congested event bus and the reported response-timeout change. Done means identifying a reproducible cause and documenting a specific configuration or operational fix.