jenkinsci / jenkinsci/git-plugin

[JENKINS-54106] Long delay from github webhook to polling when polling threads all busy

Open
#3,355 6 comments 0 reactions 0 assignees View on GitHub
component:git-plugin component:github-plugin imported-jira-issue priority:major resolution:unresolved
Dominant language
Java
Stars
694
Forks
1.1k
Avg merge
1h 29m
Merged PRs (30d)
3

Description

I am seeing some long delays between github webhook events and jobs polling for changes (e.g. from GitHub Hook Log). Note the almost 17 1/2 hour gap between the event being received and the polling being performed.

 

Started on Oct 16, 2018 2:46:44 PM

Started by event from 43.148.32.90 ? https:///github-webhook/ on Mon Oct 15 21:19:54 BST 2018

[poll] Last Built Revision: Revision c7013e0bb447b77bf13e719201ce2acb44b073af (refs/remotes/origin/)

{{ > git --version # timeout=30}}

using GIT_SSH to set credentials

{{ > git ls-remote -h # timeout=30}}

Found 345 remote heads on

[poll] Latest remote head revision on refs/heads/ is: c7013e0bb447b77bf13e719201ce2acb44b073af - already built by 34835

Done. Took 3 sec

No changes

 

I have checked that github is sending the webhook notifications and these get a http 200 response code.

The Jenkins Log reports the PushEvents are being received and that my build job is being "Poked" but polling is not being run for the job.

 

Oct 16, 2018 3:29:50 PM FINEST org.jenkinsci.plugins.github.webhook.GHEventPayload$PayloadHandler parse

{{Payload }}

...

Oct 16, 2018 3:29:50 PM INFO org.jenkinsci.plugins.github.webhook.subscriber.DefaultPushGHEventSubscriber onEvent

Received PushEvent for https://// from ⇒ https:///github-webhook/

Oct 16, 2018 3:29:51 PM FINE org.jenkinsci.plugins.github.webhook.subscriber.DefaultPushGHEventSubscriber$1 run

Considering to poke my_build

Oct 16, 2018 3:29:51 PM INFO org.jenkinsci.plugins.github.webhook.subscriber.DefaultPushGHEventSubscriber$1 run

Poked my_build

 

The agent that my_build runs on is not permanently busy.

Any idea what is going on here? How can I debug this further?

We have a lot of jobs (~1000) and possibly a lot (10s) of jobs polling SCMs but I can't imagine this would take 17 1/2 hours...

---
Originally reported by rg, imported from: Long delay from github webhook to polling when polling threads all busy


  • status: Open
  • priority: Major
  • component(s): git-plugin, github-plugin
  • resolution: Unresolved
  • votes: 1
  • watchers: 3
  • imported: 2025-12-02

Raw content of original issue

I am seeing some long delays between github webhook events and jobs polling for changes (e.g. from GitHub Hook Log). Note the almost 17 1/2 hour gap between the event being received and the polling being performed.

 

Started on Oct 16, 2018 2:46:44 PM
Started by event from 43.148.32.90 ? https://<jenkins>/github-webhook/ on Mon Oct 15 21:19:54 BST 2018
[poll] Last Built Revision: Revision c7013e0bb447b77bf13e719201ce2acb44b073af (refs/remotes/origin/<branch>)
{{ > git --version # timeout=30}}
using GIT_SSH to set credentials <creds>
{{ > git ls-remote -h <repo> # timeout=30}}
Found 345 remote heads on <git_url>
[poll] Latest remote head revision on refs/heads/<branch> is: c7013e0bb447b77bf13e719201ce2acb44b073af - already built by 34835
Done. Took 3 sec
No changes

 

I have checked that github is sending the webhook notifications and these get a http 200 response code.

The Jenkins Log reports the PushEvents are being received and that my build job is being "Poked" but polling is not being run for the job.

 

Oct 16, 2018 3:29:50 PM FINEST org.jenkinsci.plugins.github.webhook.GHEventPayload$PayloadHandler parse
{{Payload }}

...
Oct 16, 2018 3:29:50 PM INFO org.jenkinsci.plugins.github.webhook.subscriber.DefaultPushGHEventSubscriber onEvent
Received PushEvent for https://<github>/<user>/<repo> from <ip> ⇒ https://<jenkins>/github-webhook/
Oct 16, 2018 3:29:51 PM FINE org.jenkinsci.plugins.github.webhook.subscriber.DefaultPushGHEventSubscriber$1 run
Considering to poke my_build
Oct 16, 2018 3:29:51 PM INFO org.jenkinsci.plugins.github.webhook.subscriber.DefaultPushGHEventSubscriber$1 run
Poked my_build

 

The agent that my_build runs on is not permanently busy.

Any idea what is going on here? How can I debug this further?

We have a lot of jobs (~1000) and possibly a lot (10s) of jobs polling SCMs but I can't imagine this would take 17 1/2 hours...

environment

```
jenkins 2.107.3

git-plugin 3.9.0

github-plugin 1.29.0

github API 1.90

```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.