apache / apache/beam

Flink Go XVR tests fail on TestXLang_...: Insufficient number of network buffers

Open
#21,094 5 comments 0 reactions 0 assignees View on GitHub
bug cross-language failing test go P2
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

When running the cross-language test suites () Flink fails on TestXLang_Multi with the following error:
```

19:29:14 2021/08/27 02:29:14 (): java.io.IOException: Insufficient number of network buffers: required
17, but only 16 available. The total number of network buffers is currently set to 2048 of 32768 bytes
each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction',
'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
19:29:14 2021/08/27 02:29:14
Job state: FAILED
19:29:14 --- FAIL: TestXLang_Multi (6.26s)
```

This doesn't seem to be a parallelism problem (go test is run with "-p 1" as expected) and is only happening on this specific test.

Imported from Jira [BEAM-12815](https://issues.apache.org/jira/browse/BEAM-12815). Original Jira may contain additional context.
Reported by: danoliveira.

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the cross-language test suites, focusing on TestXLang_Multi and its network-buffer configuration. Inspect the test setup and Flink settings that determine available network buffers; done means the test completes without the insufficient-network-buffers failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, java
Domain
distributed-systems, testing-qa
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.