elastic / elastic/elastic-agent

[Flaky Test]: TestCleanup/cleanup_with_versionedHome_only_on_the_new_agent_+_extra_old_agent_installs – fatal error: found pointer to free object

Open
#14,248 14 comments 0 reactions 1 assignee Claimed by @swiatekm View on GitHub
flaky-test Team:Elastic-Agent-Control-Plane
Dominant language
Go
Stars
275
Forks
264
Avg merge
1d 23h
Merged PRs (30d)
312

Description

### Failing test case

TestCleanup/cleanup_with_versionedHome_only_on_the_new_agent_+_extra_old_agent_installs

### Error message

fatal error: found pointer to free object

### Build

https://buildkite.com/elastic/elastic-agent/builds/39244#019e1e3f-295c-4caa-8041-892ca6f0a353

### OS

Linux, Windows

### Stacktrace and notes

```markdown
=== FAIL: internal/pkg/agent/application/upgrade TestCleanup/cleanup_with_versionedHome_only_on_the_new_agent_+_extra_old_agent_installs (unknown)
rollback_test.go:680: Created fake agent install for {version:{version:0.9.9 hash:aaaaaa} useVersionInPath:false} located at "data\\elastic-agent-aaaaaa"
rollback_test.go:680: Created fake agent install for {version:{version:1.1.1 hash:aaabbb} useVersionInPath:false} located at "data\\elastic-agent-aaabbb"
rollback_test.go:680: Created fake agent install for {version:{version:1.2.3-SNAPSHOT hash:abcdef} useVersionInPath:false} located at "data\\elastic-agent-abcdef"
rollback_test.go:682: Setting version {version:1.2.3-SNAPSHOT hash:abcdef} as FROM version for the update marker
rollback_test.go:680: Created fake agent install for {version:{version:4.5.6-SNAPSHOT hash:ghijkl} useVersionInPath:true} located at "data\\elastic-agent-4.5.6-SNAPSHOT-ghijkl"
rollback_test.go:688: Setting version {version:4.5.6-SNAPSHOT hash:ghijkl} as TO version for the update marker
rollback_test.go:695: Creating symlink pointing to "data\\elastic-agent-4.5.6-SNAPSHOT-ghijkl"
rollback_test.go:701: Creating upgrade marker from {version:1.2.3-SNAPSHOT hash:abcdef} located at "data\\elastic-agent-abcdef" to {version:4.5.6-SNAPSHOT hash:ghijkl} located at "data\\elastic-agent-4.5.6-SNAPSHOT-ghijkl"
rollback_test.go:222: Loaded update marker &{Version:4.5.6-SNAPSHOT Hash:ghijkl VersionedHome:data\elastic-agent-4.5.6-SNAPSHOT-ghijkl UpdatedOn:2026-05-12 22:23:16.8818421 +0000 UTC PrevVersion:1.2.3-SNAPSHOT PrevHash:abcdef PrevVersionedHome:data\elastic-agent-abcdef Acked:false Action: Details: RollbacksAvailable:map[]}
runtime: marked free object in span 0x60a950, elemsize=64 freeindex=41 (bad use of unsafe.Pointer or having race conditions? try -d=checkptr or -race)
0xc00003c000 alloc unmarked
0xc00003c040 alloc unmarked
0xc00003c080 alloc unmarked
0xc00003c0c0 alloc unmarked
0xc00003c100 alloc unmarked
0xc00003c140 alloc unmarked
0xc00003c180 alloc unmarked
0xc00003c1c0 alloc unmarked
0xc00003c200 alloc unmarked
0xc00003c240 alloc unmarked
0xc00003c280 alloc unmarked
0xc00003c2c0 alloc unmarked
0xc00003c300 alloc unmarked
0xc00003c340 alloc unmarked
0xc00003c380 alloc unmarked
0xc00003c3c0 alloc unmarked
0xc00003c400 alloc unmarked
0xc00003c440 alloc unmarked
0xc00003c480 alloc unmarked
0xc00003c4c0 alloc unmarked
0xc00003c500 alloc unmarked
0xc00003c540 alloc unmarked
0xc00003c580 alloc unmarked
0xc00003c5c0 alloc unmarked
0xc00003c600 alloc unmarked
0xc00003c640 alloc unmarked
0xc00003c680 alloc unmarked
0xc00003c6c0 alloc unmarked
0xc00003c700 alloc unmarked
0xc00003c740 alloc unmarked
0xc00003c780 alloc unmarked
0xc00003c7c0 alloc unmarked
0xc00003c800 alloc unmarked
0xc00003c840 alloc unmarked
0xc00003c880 alloc unmarked
0xc00003c8c0 alloc unmarked
0xc00003c900 alloc unmarked
0xc00003c940 alloc unmarked
0xc00003c980 alloc unmarked
0xc00003c9c0 alloc unmarked
0xc00003ca00 alloc unmarked
0xc00003ca40 free unmarked
0xc00003ca80 free unmarked
0xc00003cac0 free unmarked
0xc00003cb00 alloc unmarked
0xc00003cb40 free unmarked
0xc00003cb80 alloc unmarked
0xc00003cbc0 free unmarked
0xc00003cc00 alloc unmarked
0xc00003cc40 free unmarked
0xc00003cc80 free unmarked
0xc00003ccc0 free unmarked
0xc00003cd00 free unmarked
0xc00003cd40 alloc unmarked
0xc00003cd80 alloc unmarked
0xc00003cdc0 alloc unmarked
0xc00003ce00 free unmarked
0xc00003ce40 free unmarked
0xc00003ce80 free unmarked
0xc00003cec0 free unmarked
0xc00003cf00 free unmarked
0xc00003cf40 free unmarked
0xc00003cf80 free unmarked
0xc00003cfc0 free unmarked
0xc00003d000 free unmarked
0xc00003d040 free unmarked
0xc00003d080 free unmarked
0xc00003d0c0 free unmarked
0xc00003d100 free unmarked
0xc00003d140 free unmarked
0xc00003d180 free unmarked
0xc00003d1c0 free unmarked
0xc00003d200 free unmarked
0xc00003d240 free unmarked
0xc00003d280 free unmarked
0xc00003d2c0 alloc unmarked
0xc00003d300 alloc unmarked
0xc00003d340 alloc unmarked
0xc00003d380 free unmarked
0xc00003d3c0 free unmarked
0xc00003d400 free unmarked
0xc00003d440 free unmarked
0xc00003d480 alloc unmarked
0xc00003d4c0 free unmarked
0xc00003d500 free unmarked
0xc00003d540 alloc unmarked
0xc00003d580 free unmarked
0xc00003d5c0 free unmarked
0xc00003d600 free unmarked
0xc00003d640 free unmarked
0xc00003d680 free unmarked
0xc00003d6c0 free unmarked
0xc00003d700 free unmarked
0xc00003d740 alloc unmarked
0xc00003d780 free unmarked
0xc00003d7c0 free unmarked
0xc00003d800 free unmarked
0xc00003d840 free unmarked
0xc00003d880 free unmarked
0xc00003d8c0 free unmarked
0xc00003d900 free unmarked
0xc00003d940 free unmarked
0xc00003d980 free unmarked
0xc00003d9c0 free unmarked
0xc00003da00 free unmarked
0xc00003da40 free unmarked
0xc00003da80 alloc unmarked
0xc00003dac0 free unmarked
0xc00003db00 free unmarked
0xc00003db40 free unmarked
0xc00003db80 free unmarked
0xc00003dbc0 free unmarked
0xc00003dc00 free unmarked
0xc00003dc40 free unmarked
0xc00003dc80 free unmarked
0xc00003dcc0 free unmarked
0xc00003dd00 free unmarked
0xc00003dd40 free unmarked
0xc00003dd80 free unmarked
0xc00003ddc0 free unmarked
0xc00003de00 free unmarked
0xc00003de40 free unmarked
0xc00003de80 free unmarked
0xc00003dec0 free unmarked
0xc00003df00 free unmarked
0xc00003df40 free unmarked
fatal error: found pointer to free object
runtime stack:
runtime.throw({0x1414bf021?, 0xc000508008?})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/panic.go:1229 +0x4d fp=0x48bbfb68 sp=0x48bbfb38 pc=0x14008f68d
runtime.(*mspan).reportZombies(0x60a950)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgcsweep.go:893 +0x325 fp=0x48bbfbe8 sp=0x48bbfb68 pc=0x14003f285
runtime.(*sweepLocked).sweep(0x2030000?, 0x0)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgcsweep.go:673 +0xe68 fp=0x48bbfd28 sp=0x48bbfbe8 pc=0x14003eb08
runtime.(*mcentral).uncacheSpan(0x140047726?, 0x141f0d848?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mcentral.go:237 +0xb3 fp=0x48bbfd50 sp=0x48bbfd28 pc=0x140028f93
runtime.(*mcache).releaseAll(0x602d40)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mcache.go:322 +0x12c fp=0x48bbfda8 sp=0x48bbfd50 pc=0x14002888c
runtime.(*mcache).prepareForSweep(0x602d40)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mcache.go:366 +0x35 fp=0x48bbfdd0 sp=0x48bbfda8 pc=0x140028995
runtime.gcMarkTermination.func4(0xc000076008)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1546 +0x25 fp=0x48bbfdf8 sp=0x48bbfdd0 pc=0x140089d65
runtime.forEachPInternal(0x1414ff800)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:2167 +0x12b fp=0x48bbfe88 sp=0x48bbfdf8 pc=0x14005b24b
runtime.gcMarkTermination.forEachP.func7()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:2126 +0x3f fp=0x48bbfeb8 sp=0x48bbfe88 pc=0x1400311ff
runtime.systemstack(0xc000510000)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:562 +0x49 fp=0x48bbfec8 sp=0x48bbfeb8 pc=0x140095a09
goroutine 16 gp=0xc00018dc20 m=7 mp=0xc000508008 [flushing proc caches]:
runtime.systemstack_switch()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:516 +0x8 fp=0xc000439c58 sp=0xc000439c48 pc=0x1400959a8
runtime.forEachP(...)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:2112
runtime.gcMarkTermination({0x60?, 0x34e540485f8?, 0x8?, 0x3?})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1545 +0x61f fp=0xc000439ea0 sp=0xc000439c58 pc=0x14003085f
runtime.gcMarkDone()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1173 +0x39e fp=0xc000439f40 sp=0xc000439ea0 pc=0x14002fbbe
runtime.gcBgMarkWorker(0xc00041c460)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1912 +0x2d9 fp=0xc000439fc8 sp=0xc000439f40 pc=0x140031819
runtime.gcBgMarkStartWorkers.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x17 fp=0xc000439fe0 sp=0xc000439fc8 pc=0x140031517
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000439fe8 sp=0xc000439fe0 pc=0x140097661
created by runtime.gcBgMarkStartWorkers in goroutine 10
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x105
goroutine 1 gp=0xc000082000 m=nil [chan receive]:
runtime.gopark(0x18?, 0xc000508008?, 0xe8?, 0x42?, 0xc0004d9720?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc0005896b8 sp=0xc000589698 pc=0x14008f7ce
runtime.chanrecv(0xc000274200, 0xc0004d979e, 0x1)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/chan.go:667 +0x44f fp=0xc000589730 sp=0xc0005896b8 pc=0x14001c4af
runtime.chanrecv1(0x876934946?, 0x1412bc080?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/chan.go:509 +0x12 fp=0xc000589758 sp=0xc000589730 pc=0x14001c032
testing.(*T).Run(0xc000002a00, {0x1414a8e32, 0xb}, 0x1414fefb0)
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2109 +0xb56 fp=0xc0005898a0 sp=0xc000589758 pc=0x1402bc1d6
testing.runTests.func1(0xc000002a00)
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2585 +0x85 fp=0xc0005898f0 sp=0xc0005898a0 pc=0x1402c07a5
testing.tRunner(0xc000002a00, 0xc0003dfad0)
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2036 +0x1cb fp=0xc0005899b0 sp=0xc0005898f0 pc=0x1402ba4ab
testing.runTests({0x1414c492d, 0x20}, {0x1414e83a3, 0x47}, 0xc0003386a8, {0x1412155a0, 0x32, 0x32}, {0xc279088b1cf5e1e8, 0x8bb4e4f595, ...})
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2583 +0x9f8 fp=0xc000589b00 sp=0xc0005899b0 pc=0x1402c05d8
testing.(*M).Run(0xc000336d20)
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2443 +0xf4c fp=0xc000589e80 sp=0xc000589b00 pc=0x1402bdb4c
main.main()
_testmain.go:154 +0x165 fp=0xc000589f48 sp=0xc000589e80 pc=0x14105dd45
runtime.main()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:290 +0x2c7 fp=0xc000589fe0 sp=0xc000589f48 pc=0x140057947
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000589fe8 sp=0xc000589fe0 pc=0x140097661
goroutine 2 gp=0xc000082780 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc000085fa8 sp=0xc000085f88 pc=0x14008f7ce
runtime.goparkunlock(...)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:468
runtime.forcegchelper()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:375 +0xb8 fp=0xc000085fe0 sp=0xc000085fa8 pc=0x140057c38
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x140097661
created by runtime.init.7 in goroutine 1
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:363 +0x1a
goroutine 3 gp=0xc000082b40 m=nil [runnable]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc000087f88 sp=0xc000087f68 pc=0x14008f7ce
runtime.goparkunlock(...)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:468
runtime.bgsweep(0xc000040200)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgcsweep.go:324 +0x151 fp=0xc000087fc8 sp=0xc000087f88 pc=0x14003d7f1
runtime.gcenable.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:214 +0x17 fp=0xc000087fe0 sp=0xc000087fc8 pc=0x14002eaf7
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000087fe8 sp=0xc000087fe0 pc=0x140097661
created by runtime.gcenable in goroutine 1
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:214 +0x66
goroutine 4 gp=0xc000082d20 m=nil [GC scavenge wait]:
runtime.gopark(0xbd77778?, 0x3b9aca00?, 0x0?, 0x0?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc000097f78 sp=0xc000097f58 pc=0x14008f7ce
runtime.goparkunlock(...)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:468
runtime.(*scavengerState).park(0x141ef8ca0)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000097fa8 sp=0xc000097f78 pc=0x14003b269
runtime.bgscavenge(0xc000040200)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000097fc8 sp=0xc000097fa8 pc=0x14003b7f9
runtime.gcenable.gowrap2()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:215 +0x17 fp=0xc000097fe0 sp=0xc000097fc8 pc=0x14002eab7
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000097fe8 sp=0xc000097fe0 pc=0x140097661
created by runtime.gcenable in goroutine 1
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:215 +0xa5
goroutine 5 gp=0xc0000830e0 m=nil [GOMAXPROCS updater (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc000099f88 sp=0xc000099f68 pc=0x14008f7ce
runtime.goparkunlock(...)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:468
runtime.updateMaxProcsGoroutine()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:7095 +0xe7 fp=0xc000099fe0 sp=0xc000099f88 pc=0x140066467
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000099fe8 sp=0xc000099fe0 pc=0x140097661
created by runtime.defaultGOMAXPROCSUpdateEnable in goroutine 1
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:7083 +0x37
goroutine 6 gp=0xc0000834a0 m=nil [finalizer wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc000093e20 sp=0xc000093e00 pc=0x14008f7ce
runtime.runFinalizers()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mfinal.go:210 +0x145 fp=0xc000093fe0 sp=0xc000093e20 pc=0x14002da85
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000093fe8 sp=0xc000093fe0 pc=0x140097661
created by runtime.createfing in goroutine 1
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mfinal.go:172 +0x3d
goroutine 18 gp=0xc0002801e0 m=nil [cleanup wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc0002a3f30 sp=0xc0002a3f10 pc=0x14008f7ce
runtime.goparkunlock(...)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:468
runtime.(*cleanupQueue).dequeue(0x141ef9020)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mcleanup.go:522 +0xd4 fp=0xc0002a3f68 sp=0xc0002a3f30 pc=0x14002a654
runtime.runCleanups()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mcleanup.go:718 +0x45 fp=0xc0002a3fe0 sp=0xc0002a3f68 pc=0x14002acc5
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc0002a3fe8 sp=0xc0002a3fe0 pc=0x140097661
created by runtime.(*cleanupQueue).createGs in goroutine 1
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mcleanup.go:672 +0xa5
goroutine 121 gp=0xc00018cf00 m=nil [chan receive]:
runtime.gopark(0x18?, 0xc000101008?, 0x98?, 0x67?, 0xc00058dac0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc000501a58 sp=0xc000501a38 pc=0x14008f7ce
runtime.chanrecv(0xc00011f600, 0xc00058db3e, 0x1)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/chan.go:667 +0x44f fp=0xc000501ad0 sp=0xc000501a58 pc=0x14001c4af
runtime.chanrecv1(0x8769a21ea?, 0x1412bc080?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/chan.go:509 +0x12 fp=0xc000501af8 sp=0xc000501ad0 pc=0x14001c032
testing.(*T).Run(0xc000276400, {0x1414e99bf, 0x4b}, 0xc000238460)
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2109 +0xb56 fp=0xc000501c40 sp=0xc000501af8 pc=0x1402bc1d6
github.com/elastic/elastic-agent/internal/pkg/agent/application/upgrade.TestCleanup(0xc000276400)
C:/buildkite-agent/builds/bk-agent-prod-azure-1778623933567179219/elastic/elastic-agent/internal/pkg/agent/application/upgrade/rollback_test.go:212 +0x13f2 fp=0xc000501ef0 sp=0xc000501c40 pc=0x140ff63f2
testing.tRunner(0xc000276400, 0x1414fefb0)
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2036 +0x1cb fp=0xc000501fb0 sp=0xc000501ef0 pc=0x1402ba4ab
testing.(*T).Run.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2101 +0x39 fp=0xc000501fe0 sp=0xc000501fb0 pc=0x1402bc479
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000501fe8 sp=0xc000501fe0 pc=0x140097661
created by testing.(*T).Run in goroutine 1
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2101 +0xb2b
goroutine 21 gp=0xc0002805a0 m=nil [GC worker (idle)]:
runtime.gopark(0x34e540485f8?, 0xc0002a5ee8?, 0x8d?, 0xaf?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc0002a5f40 sp=0xc0002a5f20 pc=0x14008f7ce
runtime.gcBgMarkWorker(0xc00041c460)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1791 +0xeb fp=0xc0002a5fc8 sp=0xc0002a5f40 pc=0x14003162b
runtime.gcBgMarkStartWorkers.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x17 fp=0xc0002a5fe0 sp=0xc0002a5fc8 pc=0x140031517
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc0002a5fe8 sp=0xc0002a5fe0 pc=0x140097661
created by runtime.gcBgMarkStartWorkers in goroutine 10
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x105
goroutine 11 gp=0xc00018d2c0 m=nil [GC worker (idle)]:
runtime.gopark(0xc000089ef0?, 0x1402ba3ec?, 0x78?, 0x9f?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc000089f40 sp=0xc000089f20 pc=0x14008f7ce
runtime.gcBgMarkWorker(0xc00041c460)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1791 +0xeb fp=0xc000089fc8 sp=0xc000089f40 pc=0x14003162b
runtime.gcBgMarkStartWorkers.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x17 fp=0xc000089fe0 sp=0xc000089fc8 pc=0x140031517
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000089fe8 sp=0xc000089fe0 pc=0x140097661
created by runtime.gcBgMarkStartWorkers in goroutine 10
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x105
goroutine 12 gp=0xc00018d4a0 m=nil [GC worker (idle)]:
runtime.gopark(0xc000095ef0?, 0x1402ba3ec?, 0x78?, 0x5f?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc000095f40 sp=0xc000095f20 pc=0x14008f7ce
runtime.gcBgMarkWorker(0xc00041c460)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1791 +0xeb fp=0xc000095fc8 sp=0xc000095f40 pc=0x14003162b
runtime.gcBgMarkStartWorkers.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x17 fp=0xc000095fe0 sp=0xc000095fc8 pc=0x140031517
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000095fe8 sp=0xc000095fe0 pc=0x140097661
created by runtime.gcBgMarkStartWorkers in goroutine 10
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x105
goroutine 13 gp=0xc00018d680 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc00043bf40 sp=0xc00043bf20 pc=0x14008f7ce
runtime.gcBgMarkWorker(0xc00041c460)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1791 +0xeb fp=0xc00043bfc8 sp=0xc00043bf40 pc=0x14003162b
runtime.gcBgMarkStartWorkers.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x17 fp=0xc00043bfe0 sp=0xc00043bfc8 pc=0x140031517
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc00043bfe8 sp=0xc00043bfe0 pc=0x140097661
created by runtime.gcBgMarkStartWorkers in goroutine 10
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x105
goroutine 14 gp=0xc00018d860 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc00043df40 sp=0xc00043df20 pc=0x14008f7ce
runtime.gcBgMarkWorker(0xc00041c460)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1791 +0xeb fp=0xc00043dfc8 sp=0xc00043df40 pc=0x14003162b
runtime.gcBgMarkStartWorkers.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x17 fp=0xc00043dfe0 sp=0xc00043dfc8 pc=0x140031517
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc00043dfe8 sp=0xc00043dfe0 pc=0x140097661
created by runtime.gcBgMarkStartWorkers in goroutine 10
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x105
goroutine 15 gp=0xc00018da40 m=nil [GC worker (idle)]:
runtime.gopark(0x34e540485f8?, 0x0?, 0x0?, 0x0?, 0x0?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc000437f40 sp=0xc000437f20 pc=0x14008f7ce
runtime.gcBgMarkWorker(0xc00041c460)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1791 +0xeb fp=0xc000437fc8 sp=0xc000437f40 pc=0x14003162b
runtime.gcBgMarkStartWorkers.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x17 fp=0xc000437fe0 sp=0xc000437fc8 pc=0x140031517
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000437fe8 sp=0xc000437fe0 pc=0x140097661
created by runtime.gcBgMarkStartWorkers in goroutine 10
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x105
goroutine 22 gp=0xc000280780 m=nil [runnable]:
runtime.gopark(0xc00040a700?, 0xc000505e88?, 0x0?, 0x6e?, 0xc000505e70?)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:462 +0xce fp=0xc000505e38 sp=0xc000505e18 pc=0x14008f7ce
runtime.goparkunlock(...)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/proc.go:468
runtime.semacquire1(0x141ef9d44, 0x0, 0x0, 0x0, 0xd)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/sema.go:192 +0x245 fp=0xc000505ea0 sp=0xc000505e38 pc=0x14006d225
runtime.semacquire(...)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/sema.go:143
runtime.gcMarkDone()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1018 +0x32 fp=0xc000505f40 sp=0xc000505ea0 pc=0x14002f852
runtime.gcBgMarkWorker(0xc00041c460)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1912 +0x2d9 fp=0xc000505fc8 sp=0xc000505f40 pc=0x140031819
runtime.gcBgMarkStartWorkers.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x17 fp=0xc000505fe0 sp=0xc000505fc8 pc=0x140031517
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000505fe8 sp=0xc000505fe0 pc=0x140097661
created by runtime.gcBgMarkStartWorkers in goroutine 10
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/mgc.go:1695 +0x105
goroutine 111 gp=0xc0002803c0 m=10 mp=0xc000101008 [running]:
runtime.cgocall(0x140017880, 0xc000101358)
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/cgocall.go:167 +0x4e fp=0xc0000593c0 sp=0xc000059358 pc=0x14008be8e
syscall.syscalln(0x0?, 0x0?, {0xc000059468?, 0xbf?, 0xbf?})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/syscall_windows.go:431 +0x4e fp=0xc0000593e0 sp=0xc0000593c0 pc=0x140093aee
syscall.SyscallN(0x7ff887547520, {0xc000059468, 0x1, 0x1})
C:/Users/Buildkite/.go/go-1.26.3/src/syscall/dll_windows.go:99 +0x45 fp=0xc000059430 sp=0xc0000593e0 pc=0x140113205
syscall.RemoveDirectory(0xc00047de00)
C:/Users/Buildkite/.go/go-1.26.3/src/syscall/zsyscall_windows.go:1038 +0xcb fp=0xc0000594a8 sp=0xc000059430 pc=0x14012812b
os.Remove({0xc000486160, 0xbf})
C:/Users/Buildkite/.go/go-1.26.3/src/os/file_windows.go:234 +0x188 fp=0xc000059510 sp=0xc0000594a8 pc=0x14018bf88
os.removeAll({0xc000486160, 0xbf})
C:/Users/Buildkite/.go/go-1.26.3/src/os/removeall_at.go:29 +0x1c5 fp=0xc000059618 sp=0xc000059510 pc=0x14018f185
os.RemoveAll(...)
C:/Users/Buildkite/.go/go-1.26.3/src/os/path.go:74
github.com/elastic/elastic-agent/internal/pkg/agent/install.RemovePath(0xc0001167e0, {0xc000486160, 0xbf})
C:/buildkite-agent/builds/bk-agent-prod-azure-1778623933567179219/elastic/elastic-agent/internal/pkg/agent/install/uninstall.go:299 +0x130 fp=0xc000059718 sp=0xc000059618 pc=0x140ed4230
github.com/elastic/elastic-agent/internal/pkg/agent/install.RemoveBut(0xc0001167e0, {0xc000486160, 0xbf}, 0x1, {0x0, 0x0, 0x0})
C:/buildkite-agent/builds/bk-agent-prod-azure-1778623933567179219/elastic/elastic-agent/internal/pkg/agent/install/uninstall.go:319 +0x2d2 fp=0xc000059840 sp=0xc000059718 pc=0x140ed4852
github.com/elastic/elastic-agent/internal/pkg/agent/application/upgrade.cleanup(0xc0001167e0, {0xc00045e420, 0xa5}, 0x1, 0x0, 0x0, {0xc000238dc0, 0x1, 0x1})
C:/buildkite-agent/builds/bk-agent-prod-azure-1778623933567179219/elastic/elastic-agent/internal/pkg/agent/application/upgrade/rollback.go:220 +0x1745 fp=0xc000059c90 sp=0xc000059840 pc=0x140fa8425
github.com/elastic/elastic-agent/internal/pkg/agent/application/upgrade.TestCleanup.func5(0xc000434e00)
C:/buildkite-agent/builds/bk-agent-prod-azure-1778623933567179219/elastic/elastic-agent/internal/pkg/agent/application/upgrade/rollback_test.go:227 +0x6b9 fp=0xc000059ef0 sp=0xc000059c90 pc=0x140ff6d79
testing.tRunner(0xc000434e00, 0xc000238460)
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2036 +0x1cb fp=0xc000059fb0 sp=0xc000059ef0 pc=0x1402ba4ab
testing.(*T).Run.gowrap1()
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2101 +0x39 fp=0xc000059fe0 sp=0xc000059fb0 pc=0x1402bc479
runtime.goexit({})
C:/Users/Buildkite/.go/go-1.26.3/src/runtime/asm_amd64.s:1771 +0x1 fp=0xc000059fe8 sp=0xc000059fe0 pc=0x140097661
created by testing.(*T).Run in goroutine 121
C:/Users/Buildkite/.go/go-1.26.3/src/testing/testing.go:2101 +0xb2b
DONE 3784 tests, 26 skipped, 2 failures in 432.709s
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.