jenkinsci / jenkinsci/durable-task-plugin

[JENKINS-38576] Long build parameters result in shell scripts crashing

Open
#363 9 comments 0 reactions 0 assignees View on GitHub
component:durable-task-plugin imported-jira-issue priority:major resolution:unresolved
Dominant language
Java
Stars
30
Forks
101
No merged PRs in 30d

Description

I set up a test pipeline project, which has two string parameters, diff1 and diff2. The pipeline groovy text is as follows 

stage('Initiating from Master') {

    node('master') {

writeFile file:"encoded_patch1.txt", text:diff1

archive "encoded_patch1.txt" // So we can check the whole string was received

writeFile file:"encoded_patch2.txt", text:diff2

archive "encoded_patch2.txt" // So we can check the whole string was received

sh "echo hello"

    }

}

I then created a python script to call this

from __future__ import print_function

import requests

import platform, subprocess

import json

import pprint

import os

import sys

import re



diff1_length = int(sys.argv[1])

diff2_length = int(sys.argv[2])

diff1_text = "w" + ("x" * diff1_length) + "y"

diff2_text = "a" + ("b" * diff2_length) + "c"

diff1_param = ("{\"name\": \"diff1\", \"value\": \"%s\"}") % diff1_text

diff2_param = ("{\"name\": \"diff2\", \"value\": \"%s\"}") % diff2_text



form_data = {

    "json" : ("{\"parameter\": [%s, %s]}") % (diff1_param, diff2_param),

}



jenkins_url = "http://my.ser.ver.url:8080"

job_url = jenkins_url +"/job/TestParameterSizeBug/build"

user = "Me"

password = "Password"



build_request_result = requests.post(job_url, data=form_data, auth=(user, password))

print ("Build Reguest returned %s\n" % build_request_result)

Now when I run the python script, all is well so long as both parameters are kept below 13064. But if either of them is 13064 or more, then I get the following error

```
java.io.IOException: Cannot run program "nohup" (in directory "/var/lib/jenkins/workspace/TestParameterSizeBug"): error=7, Argument list too long
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
at hudson.Proc$LocalProc.(Proc.java:243)
at hudson.Proc$LocalProc.(Proc.java:212)
at hudson.Launcher$LocalLauncher.launch(Launcher.java:815)
at hudson.Launcher$ProcStarter.start(Launcher.java:381)
at org.jenkinsci.plugins.durabletask.BourneShellScript.launchWithCookie(BourneShellScript.java:147)
at org.jenkinsci.plugins.durabletask.FileMonitoringTask.launch(FileMonitoringTask.java:61)
at org.jenkinsci.plugins.workflow.steps.durable_task.DurableTaskStep$Execution.start(DurableTaskStep.java:158)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeStep(DSL.java:184)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeMethod(DSL.java:126)
at org.jenkinsci.plugins.workflow.cps.CpsScript.invokeMethod(CpsScript.java:109)
at groovy.lang.GroovyObject$invokeMethod.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:151)
at org.kohsuke.groovy.sandbox.GroovyInterceptor.onMethodCall(GroovyInterceptor.java:21)
at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.SandboxInterceptor.onMethodCall(SandboxInterceptor.java:115)
at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:149)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:146)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:123)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:123)
at com.cloudbees.groovy.cps.sandbox.SandboxInvoker.methodCall(SandboxInvoker.java:16)
at WorkflowScript.run(WorkflowScript:7)
at ___cps.transform___(Native Method)
at com.cloudbees.groovy.cps.impl.ContinuationGroup.methodCall(ContinuationGroup.java:48)
at com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.dispatchOrArg(FunctionCallBlock.java:109)
at com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.fixArg(FunctionCallBlock.java:82)
at sun.reflect.GeneratedMethodAccessor441.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.cloudbees.groovy.cps.impl.ContinuationPtr$ContinuationImpl.receive(ContinuationPtr.java:72)
at com.cloudbees.groovy.cps.impl.ConstantBlock.eval(ConstantBlock.java:21)
at com.cloudbees.groovy.cps.Next.step(Next.java:58)
at com.cloudbees.groovy.cps.Continuable.run0(Continuable.java:154)
at org.jenkinsci.plugins.workflow.cps.SandboxContinuable.access$001(SandboxContinuable.java:18)
at org.jenkinsci.plugins.workflow.cps.SandboxContinuable$1.call(SandboxContinuable.java:33)
at org.jenkinsci.plugins.workflow.cps.SandboxContinuable$1.call(SandboxContinuable.java:30)
at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.GroovySandbox.runInSandbox(GroovySandbox.java:108)
at org.jenkinsci.plugins.workflow.cps.SandboxContinuable.run0(SandboxContinuable.java:30)
at org.jenkinsci.plugins.workflow.cps.CpsThread.runNextChunk(CpsThread.java:163)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.run(CpsThreadGroup.java:324)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.access$100(CpsThreadGroup.java:78)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:236)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:224)
at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$2.call(CpsVmExecutorService.java:63)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:112)
at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: error=7, Argument list too long
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.(UNIXProcess.java:187)
at java.lang.ProcessImpl.start(ProcessImpl.java:130)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
at hudson.Proc$LocalProc.(Proc.java:243)
at hudson.Proc$LocalProc.(Proc.java:212)
at hudson.Launcher$LocalLauncher.launch(Launcher.java:815)
at hudson.Launcher$ProcStarter.start(Launcher.java:381)
at org.jenkinsci.plugins.durabletask.BourneShellScript.launchWithCookie(BourneShellScript.java:147)
at org.jenkinsci.plugins.durabletask.FileMonitoringTask.launch(FileMonitoringTask.java:61)
at org.jenkinsci.plugins.workflow.steps.durable_task.DurableTaskStep$Execution.start(DurableTaskStep.java:158)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeStep(DSL.java:184)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeMethod(DSL.java:126)
at org.jenkinsci.plugins.workflow.cps.CpsScript.invokeMethod(CpsScript.java:109)
at groovy.lang.GroovyObject$invokeMethod.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:151)
at org.kohsuke.groovy.sandbox.GroovyInterceptor.onMethodCall(GroovyInterceptor.java:21)
at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.SandboxInterceptor.onMethodCall(SandboxInterceptor.java:115)
at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:149)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:146)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:123)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:123)
at com.cloudbees.groovy.cps.sandbox.SandboxInvoker.methodCall(SandboxInvoker.java:16)
... 29 more
Finished: FAILURE

```

Note that both strings appear to be received correctly (that's why I made the first and last characters different, so I could verify that)

Note also that the result is the same if I comment out the writeFile and archive lines.

---
Originally reported by jonhodgson, imported from: Long build parameters result in shell scripts crashing


  • status: Open
  • priority: Major
  • component(s): durable-task-plugin
  • resolution: Unresolved
  • votes: 2
  • watchers: 7
  • imported: 2025-12-09

Raw content of original issue

I set up a test pipeline project, which has two string parameters, diff1 and diff2. The pipeline groovy text is as follows 





stage('Initiating from Master') {

    node('master') {

        writeFile file:"encoded_patch1.txt", text:diff1

        archive "encoded_patch1.txt" // So we can check the whole string was received

        writeFile file:"encoded_patch2.txt", text:diff2

        archive "encoded_patch2.txt" // So we can check the whole string was received

        sh "echo hello"

    }

}






I then created a python script to call this





from __future__ import print_function

import requests

import platform, subprocess

import json

import pprint

import os

import sys

import re



diff1_length = int(sys.argv[1])

diff2_length = int(sys.argv[2])

diff1_text = "w" + ("x" * diff1_length) + "y"

diff2_text = "a" + ("b" * diff2_length) + "c"

diff1_param = ("{\"name\": \"diff1\", \"value\": \"%s\"}") % diff1_text

diff2_param = ("{\"name\": \"diff2\", \"value\": \"%s\"}") % diff2_text



form_data = {

    "json" : ("{\"parameter\": [%s, %s]}") % (diff1_param, diff2_param),

}



jenkins_url = "http://my.ser.ver.url:8080"

job_url = jenkins_url +"/job/TestParameterSizeBug/build"

user = "Me"

password = "Password"



build_request_result = requests.post(job_url, data=form_data, auth=(user, password))

print ("Build Reguest returned %s\n" % build_request_result)






Now when I run the python script, all is well so long as both parameters are kept below 13064. But if either of them is 13064 or more, then I get the following error





java.io.IOException: Cannot run program "nohup" (in directory "/var/lib/jenkins/workspace/TestParameterSizeBug"): error=7, Argument list too long

	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)

	at hudson.Proc$LocalProc.<init>(Proc.java:243)

	at hudson.Proc$LocalProc.<init>(Proc.java:212)

	at hudson.Launcher$LocalLauncher.launch(Launcher.java:815)

	at hudson.Launcher$ProcStarter.start(Launcher.java:381)

	at org.jenkinsci.plugins.durabletask.BourneShellScript.launchWithCookie(BourneShellScript.java:147)

	at org.jenkinsci.plugins.durabletask.FileMonitoringTask.launch(FileMonitoringTask.java:61)

	at org.jenkinsci.plugins.workflow.steps.durable_task.DurableTaskStep$Execution.start(DurableTaskStep.java:158)

	at org.jenkinsci.plugins.workflow.cps.DSL.invokeStep(DSL.java:184)

	at org.jenkinsci.plugins.workflow.cps.DSL.invokeMethod(DSL.java:126)

	at org.jenkinsci.plugins.workflow.cps.CpsScript.invokeMethod(CpsScript.java:109)

	at groovy.lang.GroovyObject$invokeMethod.call(Unknown Source)

	at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)

	at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)

	at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:151)

	at org.kohsuke.groovy.sandbox.GroovyInterceptor.onMethodCall(GroovyInterceptor.java:21)

	at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.SandboxInterceptor.onMethodCall(SandboxInterceptor.java:115)

	at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:149)

	at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:146)

	at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:123)

	at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:123)

	at com.cloudbees.groovy.cps.sandbox.SandboxInvoker.methodCall(SandboxInvoker.java:16)

	at WorkflowScript.run(WorkflowScript:7)

	at ___cps.transform___(Native Method)

	at com.cloudbees.groovy.cps.impl.ContinuationGroup.methodCall(ContinuationGroup.java:48)

	at com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.dispatchOrArg(FunctionCallBlock.java:109)

	at com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.fixArg(FunctionCallBlock.java:82)

	at sun.reflect.GeneratedMethodAccessor441.invoke(Unknown Source)

	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

	at java.lang.reflect.Method.invoke(Method.java:606)

	at com.cloudbees.groovy.cps.impl.ContinuationPtr$ContinuationImpl.receive(ContinuationPtr.java:72)

	at com.cloudbees.groovy.cps.impl.ConstantBlock.eval(ConstantBlock.java:21)

	at com.cloudbees.groovy.cps.Next.step(Next.java:58)

	at com.cloudbees.groovy.cps.Continuable.run0(Continuable.java:154)

	at org.jenkinsci.plugins.workflow.cps.SandboxContinuable.access$001(SandboxContinuable.java:18)

	at org.jenkinsci.plugins.workflow.cps.SandboxContinuable$1.call(SandboxContinuable.java:33)

	at org.jenkinsci.plugins.workflow.cps.SandboxContinuable$1.call(SandboxContinuable.java:30)

	at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.GroovySandbox.runInSandbox(GroovySandbox.java:108)

	at org.jenkinsci.plugins.workflow.cps.SandboxContinuable.run0(SandboxContinuable.java:30)

	at org.jenkinsci.plugins.workflow.cps.CpsThread.runNextChunk(CpsThread.java:163)

	at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.run(CpsThreadGroup.java:324)

	at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.access$100(CpsThreadGroup.java:78)

	at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:236)

	at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:224)

	at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$2.call(CpsVmExecutorService.java:63)

	at java.util.concurrent.FutureTask.run(FutureTask.java:262)

	at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:112)

	at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)

	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)

	at java.util.concurrent.FutureTask.run(FutureTask.java:262)

	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

	at java.lang.Thread.run(Thread.java:745)

Caused by: java.io.IOException: error=7, Argument list too long

	at java.lang.UNIXProcess.forkAndExec(Native Method)

	at java.lang.UNIXProcess.<init>(UNIXProcess.java:187)

	at java.lang.ProcessImpl.start(ProcessImpl.java:130)

	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)

	at hudson.Proc$LocalProc.<init>(Proc.java:243)

	at hudson.Proc$LocalProc.<init>(Proc.java:212)

	at hudson.Launcher$LocalLauncher.launch(Launcher.java:815)

	at hudson.Launcher$ProcStarter.start(Launcher.java:381)

	at org.jenkinsci.plugins.durabletask.BourneShellScript.launchWithCookie(BourneShellScript.java:147)

	at org.jenkinsci.plugins.durabletask.FileMonitoringTask.launch(FileMonitoringTask.java:61)

	at org.jenkinsci.plugins.workflow.steps.durable_task.DurableTaskStep$Execution.start(DurableTaskStep.java:158)

	at org.jenkinsci.plugins.workflow.cps.DSL.invokeStep(DSL.java:184)

	at org.jenkinsci.plugins.workflow.cps.DSL.invokeMethod(DSL.java:126)

	at org.jenkinsci.plugins.workflow.cps.CpsScript.invokeMethod(CpsScript.java:109)

	at groovy.lang.GroovyObject$invokeMethod.call(Unknown Source)

	at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)

	at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)

	at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:151)

	at org.kohsuke.groovy.sandbox.GroovyInterceptor.onMethodCall(GroovyInterceptor.java:21)

	at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.SandboxInterceptor.onMethodCall(SandboxInterceptor.java:115)

	at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:149)

	at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:146)

	at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:123)

	at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:123)

	at com.cloudbees.groovy.cps.sandbox.SandboxInvoker.methodCall(SandboxInvoker.java:16)

	... 29 more

Finished: FAILURE






Note that both strings appear to be received correctly (that's why I made the first and last characters different, so I could verify that)



Note also that the result is the same if I comment out the writeFile and archive lines.

  • environment: Jenkins v2.23, pipeline 2.4, Debian Linux 64 bit (wheezy)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.