jenkinsci / jenkinsci/plot-plugin

[JENKINS-43708] Plot data truncated after failed build

Open
#272 1 comment 0 reactions 0 assignees View on GitHub
component:plot-plugin imported-jira-issue priority:major resolution:unresolved
Dominant language
Java
Stars
62
Forks
93
Avg merge
1d 17h
Merged PRs (30d)
1

Description

Jenkins suffered a communications issue between master and slave(s), leading to some number of jobs failing with the following error mid job:

FATAL: command execution failed

java.io.IOException
at hudson.remoting.Channel.close(Channel.java:1292)
at hudson.remoting.Channel.close(Channel.java:1263)
at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:708)
at hudson.slaves.SlaveComputer.kill(SlaveComputer.java:675)
at hudson.model.AbstractCIBase.killComputer(AbstractCIBase.java:86)
at jenkins.model.Jenkins.access$2000(Jenkins.java:303)
at jenkins.model.Jenkins$22.run(Jenkins.java:3315)
at hudson.model.Queue._withLock(Queue.java:1339)
at hudson.model.Queue.withLock(Queue.java:1216)
at jenkins.model.Jenkins._cleanUpDisconnectComputers(Jenkins.java:3309)
at jenkins.model.Jenkins.cleanUp(Jenkins.java:3185)
at hudson.WebAppMain.contextDestroyed(WebAppMain.java:380)
at org.eclipse.jetty.server.handler.ContextHandler.callContextDestroyed(ContextHandler.java:808)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextDestroyed(ServletContextHandler.java:457)
at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:842)
at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:215)
at org.eclipse.jetty.webapp.WebAppContext.doStop(WebAppContext.java:529)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:143)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:73)
at org.eclipse.jetty.server.Server.doStop(Server.java:456)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at winstone.Launcher.shutdown(Launcher.java:305)
at winstone.ShutdownHook.run(ShutdownHook.java:25)
Caused: hudson.remoting.ChannelClosedException: channel is already closed
at hudson.remoting.Channel.send(Channel.java:605)
at hudson.remoting.Request.call(Request.java:130)
at hudson.remoting.Channel.call(Channel.java:829)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:257)
at com.sun.proxy.$Proxy72.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1043)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1035)
at hudson.tasks.CommandInterpreter.join(CommandInterpreter.java:155)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:109)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:66)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:779)
at hudson.model.Build$BuildExecution.build(Build.java:206)
at hudson.model.Build$BuildExecution.doRun(Build.java:163)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
at hudson.model.Run.execute(Run.java:1730)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:405)
Build step 'Execute shell' marked build as failure
Checking console output
Recording plot data

This was build #2403, now the plot CSV file and graph only have data from builds #2404 and onwards.

CSV contents

"Title","update-checkpoint-btree Throughput - Insert"

"Value","Series Label","Build Number","Build Date","URL"
"110437942","Insert count","2404","1492587626039",""
"108332564","Insert count","2405","1492598976073",""
"110567461","Insert count","2406","1492605760278",""
"116402275","Insert count","2407","1492614623955",""
"144386603","Insert count","2408","1492625892770",""
"130653084","Insert count","2409","1492638549770",""
"120614552","Insert count","2410","1492650082018",""

The truncation here shouldn't occur as we have no lost historical plot data.

---
Originally reported by da5id, imported from: Plot data truncated after failed build


  • assignee: nidaley
  • status: Open
  • priority: Major
  • component(s): plot-plugin
  • resolution: Unresolved
  • votes: 0
  • watchers: 1
  • imported: 20260512-210953

Raw content of original issue

Jenkins suffered a communications issue between master and slave(s), leading to some number of jobs failing with the following error mid job:



FATAL: command execution failed

java.io.IOException
at hudson.remoting.Channel.close(Channel.java:1292)
at hudson.remoting.Channel.close(Channel.java:1263)
at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:708)
at hudson.slaves.SlaveComputer.kill(SlaveComputer.java:675)
at hudson.model.AbstractCIBase.killComputer(AbstractCIBase.java:86)
at jenkins.model.Jenkins.access$2000(Jenkins.java:303)
at jenkins.model.Jenkins$22.run(Jenkins.java:3315)
at hudson.model.Queue._withLock(Queue.java:1339)
at hudson.model.Queue.withLock(Queue.java:1216)
at jenkins.model.Jenkins._cleanUpDisconnectComputers(Jenkins.java:3309)
at jenkins.model.Jenkins.cleanUp(Jenkins.java:3185)
at hudson.WebAppMain.contextDestroyed(WebAppMain.java:380)
at org.eclipse.jetty.server.handler.ContextHandler.callContextDestroyed(ContextHandler.java:808)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextDestroyed(ServletContextHandler.java:457)
at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:842)
at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:215)
at org.eclipse.jetty.webapp.WebAppContext.doStop(WebAppContext.java:529)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:143)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:73)
at org.eclipse.jetty.server.Server.doStop(Server.java:456)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at winstone.Launcher.shutdown(Launcher.java:305)
at winstone.ShutdownHook.run(ShutdownHook.java:25)
Caused: hudson.remoting.ChannelClosedException: channel is already closed
at hudson.remoting.Channel.send(Channel.java:605)
at hudson.remoting.Request.call(Request.java:130)
at hudson.remoting.Channel.call(Channel.java:829)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:257)
at com.sun.proxy.$Proxy72.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1043)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1035)
at hudson.tasks.CommandInterpreter.join(CommandInterpreter.java:155)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:109)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:66)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:779)
at hudson.model.Build$BuildExecution.build(Build.java:206)
at hudson.model.Build$BuildExecution.doRun(Build.java:163)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
at hudson.model.Run.execute(Run.java:1730)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:405)
Build step 'Execute shell' marked build as failure
Checking console output
Recording plot data


This was build #2403, now the plot CSV file and graph only have data from builds #2404 and onwards.

CSV contents



"Title","update-checkpoint-btree Throughput - Insert"

"Value","Series Label","Build Number","Build Date","URL"
"110437942","Insert count","2404","1492587626039",""
"108332564","Insert count","2405","1492598976073",""
"110567461","Insert count","2406","1492605760278",""
"116402275","Insert count","2407","1492614623955",""
"144386603","Insert count","2408","1492625892770",""
"130653084","Insert count","2409","1492638549770",""
"120614552","Insert count","2410","1492650082018",""


The truncation here shouldn't occur as we have no lost historical plot data.

environment

```
Plot Plugin 1.9

Jenkins 2.5.5

Amazon Linux AMI 2017.03

openjdk version "1.8.0_121"
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.