[Flaky Test] github.com/elastic/beats/v7/x-pack/filebeat/fbreceiver TestConsumeContract

## Flaky Test

* **Test Name:** TestConsumeContract
* **Scope:** github.com/elastic/beats/v7/x-pack/filebeat/fbreceiver
* **File:** N/A
* **Location:** N/A
* **Buildkite Link:** https://buildkite.com/organizations/elastic/analytics/suites/beats/tests/2ce4afa7-5977-80c7-adbc-484817622db1
* **Flaky Instances:** 1
* **Latest Occurrence:** 2026-08-27T04:21:28.807Z

### Details

```json
{
"id": "2ce4afa7-5977-80c7-adbc-484817622db1",
"web_url": "https://buildkite.com/organizations/elastic/analytics/suites/beats/tests/2ce4afa7-5977-80c7-adbc-484817622db1",
"scope": "github.com/elastic/beats/v7/x-pack/filebeat/fbreceiver",
"name": "TestConsumeContract",
"location": null,
"file_name": null,
"instances": 1,
"latest_occurrence_at": "2026-08-27T04:21:28.807Z",
"most_recent_instance_at": "2026-08-27T04:21:28.807Z",
"last_resolved_at": null,
"ownership_team_ids": [],
"failure_examples_count": 1
}
```

### Failure Examples

**Example 1:**
**Run:** https://api.buildkite.com/v2/analytics/organizations/elastic/suites/beats/runs/8f05eb07-2852-8149-b880-6b1008503a9c
**Time:** 2026-08-27T04:11:15.407Z
**Stacktrace:**

```
=== RUN TestConsumeContract
oteltest.go:289: found unexpected goroutines:
[Goroutine 254 in state chan receive, 2 minutes, with github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run.func3 on top of the stack:
github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run.func3()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/filebeat.go:341 +0x26
created by github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run in goroutine 253
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/filebeat.go:340 +0x733
Goroutine 246 in state select, 2 minutes, with github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*Pipeline).reapClosedClients on top of the stack:
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*Pipeline).reapClosedClients(0x2315be37f340)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/pipeline.go:392 +0x345
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*Pipeline).startReaper.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/pipeline.go:341 +0x17
sync.(*WaitGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:258 +0x4a
created by sync.(*WaitGroup).Go in goroutine 226
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:238 +0x73
Goroutine 276 in state chan receive, with github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Event on top of the stack:
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Event(0x2315be0b2000?)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/fswatch.go:574 +0x91
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileProspector).Run.func2()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/prospector.go:363 +0x38b
github.com/elastic/go-concert/unison.(*MultiErrGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/multierrgroup.go:42 +0x66
created by github.com/elastic/go-concert/unison.(*MultiErrGroup).Go in goroutine 268
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/multierrgroup.go:40 +0x76
Goroutine 243 in state select, with github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*spawningWorker).run on top of the stack:
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*spawningWorker).run(0x2315be776be0)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/output_otel.go:429 +0xca
created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.makeSpawningWorker in goroutine 226
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/output_otel.go:422 +0x125
Goroutine 266 in state select, 2 minutes, with github.com/elastic/beats/v7/filebeat/registrar.(*Registrar).Run on top of the stack:
github.com/elastic/beats/v7/filebeat/registrar.(*Registrar).Run(0x2315beda0300)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/registrar/registrar.go:152 +0x20c
github.com/elastic/beats/v7/filebeat/registrar.(*Registrar).Start.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/registrar/registrar.go:116 +0x17
sync.(*WaitGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:258 +0x4a
created by sync.(*WaitGroup).Go in goroutine 256
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:238 +0x73
Goroutine 248 in state IO wait, with internal/poll.runtime_pollWait on top of the stack:
internal/poll.runtime_pollWait(0x75be76c6d600, 0x72)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0x2315bed98400?, 0x20?, 0x0)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x2315bed98400)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/internal/poll/fd_unix.go:613 +0x28c
net.(*netFD).accept(0x2315bed98400)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/net/fd_unix.go:150 +0x29
net.(*UnixListener).accept(0x2315be9a2d98?)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/net/unixsock_posix.go:172 +0x16
net.(*UnixListener).Accept(0x2315bead54a0)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/net/unixsock.go:267 +0x30
net/http.(*Server).Serve(0x2315bed90700, {0x70f1190, 0x2315bead54a0})
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/net/http/server.go:3434 +0x30c
github.com/elastic/beats/v7/libbeat/api.(*Server).Start.func1({0x70f1190, 0x2315bead54a0})
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/api/server.go:94 +0x146
created by github.com/elastic/beats/v7/libbeat/api.(*Server).Start in goroutine 226
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/api/server.go:90 +0x392
Goroutine 256 in state chan receive, 2 minutes, with github.com/elastic/beats/v7/filebeat/beater.(*signalWait).Wait on top of the stack:
github.com/elastic/beats/v7/filebeat/beater.(*signalWait).Wait(...)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/signalwait.go:44
github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run(0x2315beda0240, 0x2315bec62408)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/filebeat.go:544 +0x2731
github.com/elastic/beats/v7/x-pack/libbeat/cmd/instance.(*BeatReceiver).Start.func3()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/x-pack/libbeat/cmd/instance/receiver.go:203 +0x42
created by github.com/elastic/beats/v7/x-pack/libbeat/cmd/instance.(*BeatReceiver).Start in goroutine 250
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/x-pack/libbeat/cmd/instance/receiver.go:202 +0x7df
Goroutine 253 in state chan receive, 2 minutes, with github.com/elastic/beats/v7/filebeat/beater.(*signalWait).Wait on top of the stack:
github.com/elastic/beats/v7/filebeat/beater.(*signalWait).Wait(...)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/signalwait.go:44
github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run(0x2315beafe8a0, 0x2315bec62008)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/filebeat.go:544 +0x2731
github.com/elastic/beats/v7/x-pack/libbeat/cmd/instance.(*BeatReceiver).Start.func3()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/x-pack/libbeat/cmd/instance/receiver.go:203 +0x42
created by github.com/elastic/beats/v7/x-pack/libbeat/cmd/instance.(*BeatReceiver).Start in goroutine 249
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/x-pack/libbeat/cmd/instance/receiver.go:202 +0x7df
Goroutine 213 in state select, 2 minutes, with github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*Pipeline).reapClosedClients on top of the stack:
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*Pipeline).reapClosedClients(0x2315bdee4a80)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/pipeline.go:392 +0x345
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*Pipeline).startReaper.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/pipeline.go:341 +0x17
sync.(*WaitGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:258 +0x4a
created by sync.(*WaitGroup).Go in goroutine 226
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:238 +0x73
Goroutine 264 in state select, with github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*updateChan).Recv on top of the stack:
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*updateChan).Recv(0x2315beb4c3c0, {0x710a308, 0x2315be62a0a0})
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/update_writer.go:151 +0x158
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*updateWriter).run(0x2315be318780, {0x710a308, 0x2315be62a0a0})
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/update_writer.go:87 +0x56
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.newUpdateWriter.func1({0x710a308?, 0x2315be62a0a0?})
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/update_writer.go:65 +0x2a
github.com/elastic/go-concert/unison.(*TaskGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/taskgroup.go:164 +0xa3
created by github.com/elastic/go-concert/unison.(*TaskGroup).Go in goroutine 256
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/taskgroup.go:160 +0xe7
Goroutine 274 in state select, with github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*engine).waker on top of the stack:
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*engine).waker(0x2315bde7c4e0)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/engine.go:199 +0x20b
sync.(*WaitGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:258 +0x4a
created by sync.(*WaitGroup).Go in goroutine 268
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:238 +0x73
Goroutine 268 in state sync.WaitGroup.Wait, 2 minutes, with sync.runtime_SemacquireWaitGroup on top of the stack:
sync.runtime_SemacquireWaitGroup(0x18?, 0x52?)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/runtime/sema.go:114 +0x2e
sync.(*WaitGroup).Wait(0x2315be7ce7a0)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:206 +0x85
github.com/elastic/go-concert/unison.(*MultiErrGroup).Wait(0x2315be7ce780)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/multierrgroup.go:54 +0x3d
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileProspector).Run(_, {0x2315bead2ba0, {0x6d30755, 0xe}, {0x6d30755, 0xe}, {0x6d1b467, 0xa}, {{0x6d13dcd, 0x8}, ...}, ...}, ...)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/prospector.go:375 +0x49d
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*managedInput).Run(_, {0x2315bead2ba0, {0x6d30755, 0xe}, {0x6d30755, 0xe}, {0x6d1b467, 0xa}, {{0x6d13dcd, 0x8}, ...}, ...}, ...)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/input.go:113 +0x783
github.com/elastic/beats/v7/filebeat/input/v2/compat.(*runner).Start.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/v2/compat/compat.go:161 +0x40e
created by github.com/elastic/beats/v7/filebeat/input/v2/compat.(*runner).Start in goroutine 256
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/v2/compat/compat.go:138 +0xb9
Goroutine 272 in state select, 2 minutes, with github.com/elastic/go-concert/timed.Periodic on top of the stack:
github.com/elastic/go-concert/timed.Periodic({0x75be740eea88, 0x2315be62bae0}, 0xc7?, 0x2315be9a0ee0)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/timed/timed.go:82 +0xf7
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.runCleaner(0x2315be2671b8, {0x75be740eea60, 0x2315be62bae0}, 0x2315beda1980, 0x45d964b800)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/clean.go:45 +0xd1
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.initializeStoreCacheEntry.func2()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/store_cache.go:200 +0x129
created by github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.initializeStoreCacheEntry in goroutine 253
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/store_cache.go:196 +0x625
Goroutine 273 in state select, 2 minutes, with github.com/elastic/beats/v7/filebeat/registrar.(*Registrar).Run on top of the stack:
github.com/elastic/beats/v7/filebeat/registrar.(*Registrar).Run(0x2315beda18c0)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/registrar/registrar.go:152 +0x20c
github.com/elastic/beats/v7/filebeat/registrar.(*Registrar).Start.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/registrar/registrar.go:116 +0x17
sync.(*WaitGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:258 +0x4a
created by sync.(*WaitGroup).Go in goroutine 253
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:238 +0x73
Goroutine 307 in state sync.WaitGroup.Wait, 2 minutes, with sync.runtime_SemacquireWaitGroup on top of the stack:
sync.runtime_SemacquireWaitGroup(0x18?, 0x52?)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/runtime/sema.go:114 +0x2e
sync.(*WaitGroup).Wait(0x2315bf294830)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:206 +0x85
github.com/elastic/go-concert/unison.(*MultiErrGroup).Wait(0x2315bf294810)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/multierrgroup.go:54 +0x3d
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileProspector).Run(_, {0x2315be267bc0, {0x6d30755, 0xe}, {0x6d30755, 0xe}, {0x6d1b467, 0xa}, {{0x6d13dcd, 0x8}, ...}, ...}, ...)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/prospector.go:375 +0x49d
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*managedInput).Run(_, {0x2315be267bc0, {0x6d30755, 0xe}, {0x6d30755, 0xe}, {0x6d1b467, 0xa}, {{0x6d13dcd, 0x8}, ...}, ...}, ...)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/input.go:113 +0x783
github.com/elastic/beats/v7/filebeat/input/v2/compat.(*runner).Start.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/v2/compat/compat.go:161 +0x40e
created by github.com/elastic/beats/v7/filebeat/input/v2/compat.(*runner).Start in goroutine 253
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/v2/compat/compat.go:138 +0xb9
Goroutine 269 in state chan receive, 2 minutes, with github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run.(*signalWait).AddChan.waitChannel.func19 on top of the stack:
github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run.(*signalWait).AddChan.waitChannel.func19()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/signalwait.go:74 +0x19
github.com/elastic/beats/v7/filebeat/beater.(*signalWait).Add.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/signalwait.go:51 +0x22
created by github.com/elastic/beats/v7/filebeat/beater.(*signalWait).Add in goroutine 256
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/signalwait.go:50 +0x69
Goroutine 308 in state chan receive, 2 minutes, with github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run.(*signalWait).AddChan.waitChannel.func19 on top of the stack:
github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run.(*signalWait).AddChan.waitChannel.func19()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/signalwait.go:74 +0x19
github.com/elastic/beats/v7/filebeat/beater.(*signalWait).Add.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/signalwait.go:51 +0x22
created by github.com/elastic/beats/v7/filebeat/beater.(*signalWait).Add in goroutine 253
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/signalwait.go:50 +0x69
Goroutine 245 in state select, with github.com/elastic/beats/v7/libbeat/publisher/queue/slabqueue.(*Queue[...]).Get on top of the stack:
github.com/elastic/beats/v7/libbeat/publisher/queue/slabqueue.(*Queue[...]).Get(0x71b7340, 0x0)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/queue/slabqueue/queue.go:290 +0x251
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*queueReader).run(0x2315be776c60, 0x2315be67b800)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/queue_reader.go:58 +0xeb
created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer in goroutine 226
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/consumer.go:100 +0x1d6
Goroutine 265 in state select, 2 minutes, with github.com/elastic/go-concert/timed.Periodic on top of the stack:
github.com/elastic/go-concert/timed.Periodic({0x75be740eea88, 0x2315be62a050}, 0xc7?, 0x2315bed29ee0)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/timed/timed.go:82 +0xf7
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.runCleaner(0x2315bead2678, {0x75be740eea60, 0x2315be62a050}, 0x2315beda03c0, 0x45d964b800)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/clean.go:45 +0xd1
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.initializeStoreCacheEntry.func2()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/store_cache.go:200 +0x129
created by github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.initializeStoreCacheEntry in goroutine 256
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/store_cache.go:196 +0x625
Goroutine 215 in state IO wait, with internal/poll.runtime_pollWait on top of the stack:
internal/poll.runtime_pollWait(0x75be76c6dc00, 0x72)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0x2315be969e80?, 0x20?, 0x0)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x2315be969e80)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/internal/poll/fd_unix.go:613 +0x28c
net.(*netFD).accept(0x2315be969e80)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/net/fd_unix.go:150 +0x29
net.(*UnixListener).accept(0x2315bde68d98?)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/net/unixsock_posix.go:172 +0x16
net.(*UnixListener).Accept(0x2315beae74a0)
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/net/unixsock.go:267 +0x30
net/http.(*Server).Serve(0x2315be96ee00, {0x70f1190, 0x2315beae74a0})
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/net/http/server.go:3434 +0x30c
github.com/elastic/beats/v7/libbeat/api.(*Server).Start.func1({0x70f1190, 0x2315beae74a0})
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/api/server.go:94 +0x146
created by github.com/elastic/beats/v7/libbeat/api.(*Server).Start in goroutine 226
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/api/server.go:90 +0x392
Goroutine 275 in state select, with github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Run on top of the stack:
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Run(0x2315beb18870, {0x75be740eea60, 0x2315be742050}, 0x2315be325380, 0x0, {0x2315be93fce0?, 0x23?, 0x0?})
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/fswatch.go:156 +0x1f3
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileProspector).Run.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/prospector.go:357 +0x69
github.com/elastic/go-concert/unison.(*MultiErrGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/multierrgroup.go:42 +0x66
created by github.com/elastic/go-concert/unison.(*MultiErrGroup).Go in goroutine 268
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/multierrgroup.go:40 +0x76
Goroutine 257 in state chan receive, 2 minutes, with github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run.func3 on top of the stack:
github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run.func3()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/filebeat.go:341 +0x26
created by github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run in goroutine 256
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/beater/filebeat.go:340 +0x733
Goroutine 271 in state select, with github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*updateChan).Recv on top of the stack:
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*updateChan).Recv(0x2315be2f4f30, {0x710a308, 0x2315be62bb30})
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/update_writer.go:151 +0x158
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*updateWriter).run(0x2315be319a40, {0x710a308, 0x2315be62bb30})
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/update_writer.go:87 +0x56
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.newUpdateWriter.func1({0x710a308?, 0x2315be62bb30?})
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/internal/input-logfile/update_writer.go:65 +0x2a
github.com/elastic/go-concert/unison.(*TaskGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/taskgroup.go:164 +0xa3
created by github.com/elastic/go-concert/unison.(*TaskGroup).Go in goroutine 253
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/taskgroup.go:160 +0xe7
Goroutine 244 in state select, with github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*eventConsumer).run on top of the stack:
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*eventConsumer).run(0x2315be776c30)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/consumer.go:159 +0x2db
github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/consumer.go:89 +0x17
sync.(*WaitGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:258 +0x4a
created by sync.(*WaitGroup).Go in goroutine 226
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:238 +0x73
Goroutine 207 in state select, with github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*spawningWorker).run on top of the stack:
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*spawningWorker).run(0x2315be33ea50)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/output_otel.go:429 +0xca
created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.makeSpawningWorker in goroutine 226
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/output_otel.go:422 +0x125
Goroutine 208 in state select, with github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*eventConsumer).run on top of the stack:
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*eventConsumer).run(0x2315be33ed20)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/consumer.go:159 +0x2db
github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/consumer.go:89 +0x17
sync.(*WaitGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:258 +0x4a
created by sync.(*WaitGroup).Go in goroutine 226
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/go/src/sync/waitgroup.go:238 +0x73
Goroutine 277 in state select, 2 minutes, with github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Run.func1 on top of the stack:
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Run.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/fswatch.go:145 +0xce
created by github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Run in goroutine 275
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/fswatch.go:143 +0x135
Goroutine 209 in state select, with github.com/elastic/beats/v7/libbeat/publisher/queue/slabqueue.(*Queue[...]).Get on top of the stack:
github.com/elastic/beats/v7/libbeat/publisher/queue/slabqueue.(*Queue[...]).Get(0x71b7340, 0x0)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/queue/slabqueue/queue.go:290 +0x251
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*queueReader).run(0x2315be33ed50, 0x2315be67b9b0)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/queue_reader.go:58 +0xeb
created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer in goroutine 226
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/libbeat/publisher/pipeline/consumer.go:100 +0x1d6
Goroutine 309 in state select, with github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Run on top of the stack:
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Run(0x2315be3714a0, {0x75be740eea60, 0x2315be274e60}, 0x2315be907200, 0x0, {0x41e8ff?, 0x6dddda8?, 0x0?})
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/fswatch.go:156 +0x1f3
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileProspector).Run.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/prospector.go:357 +0x69
github.com/elastic/go-concert/unison.(*MultiErrGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/multierrgroup.go:42 +0x66
created by github.com/elastic/go-concert/unison.(*MultiErrGroup).Go in goroutine 307
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/multierrgroup.go:40 +0x76
Goroutine 310 in state chan receive, with github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Event on top of the stack:
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Event(0x2315be0b2000?)
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/fswatch.go:574 +0x91
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileProspector).Run.func2()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/prospector.go:363 +0x38b
github.com/elastic/go-concert/unison.(*MultiErrGroup).Go.func1()
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/multierrgroup.go:42 +0x66
created by github.com/elastic/go-concert/unison.(*MultiErrGroup).Go in goroutine 307
/opt/buildkite-agent/.asdf/installs/golang/1.26.7/packages/pkg/mod/github.com/elastic/go-concert@v0.3.1/unison/multierrgroup.go:40 +0x76
Goroutine 311 in state select, 2 minutes, with github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Run.func1 on top of the stack:
github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Run.func1()
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/fswatch.go:145 +0xce
created by github.com/elastic/beats/v7/filebeat/input/filestream.(*fileWatcher).Run in goroutine 309
/opt/buildkite-agent/builds/bk-agent-prod-gcp-1787803543029184779/elastic/beats-xpack-filebeat/filebeat/input/filestream/fswatch.go:143 +0x135
]
--- FAIL: TestConsumeContract (5.10s)
=== RUN TestConsumeContract/always_succeed
Sent 100, accepted=100, expected dropped=0, non-permanent errors retried=0
--- PASS: TestConsumeContract/always_succeed (2.12s)
=== RUN TestConsumeContract/random_non_permanent_error
Sent 100, accepted=100, expected dropped=0, non-permanent errors retried=1
--- PASS: TestConsumeContract/random_non_permanent_error (2.12s)
=== RUN TestConsumeContract/random_permanent_error
Sent 100, accepted=0, expected dropped=100, non-permanent errors retried=0
--- PASS: TestConsumeContract/random_permanent_error (0.21s)
=== RUN TestConsumeContract/random_error
Sent 100, accepted=0, expected dropped=100, non-permanent errors retried=0
--- PASS: TestConsumeContract/random_error (0.21s)

```

Start by reproducing TestConsumeContract in github.com/elastic/beats/v7/x-pack/filebeat/fbreceiver and inspect the Buildkite failure. Trace the unexpected goroutines through filebeat/beater/filebeat.go, filebeat/input/filestream/fswatch.go, libbeat/publisher/pipeline/pipeline.go, and the other stack frames shown. Done means the test completes without unexpected goroutines and remains reliable in repeated runs.

Written by the indexing model from the issue text.