google / google/testrun

Run time of job "NetworkOrchestrator.network_adapters_checker" and "NetworkOrchestrator.internet_conn_checker" was missed by Error Messages

Open
#1,519 2 comments 0 reactions 0 assignees View on GitHub
BE python
Dominant language
Python
Stars
56
Forks
20
Avg merge
15h 54m
Merged PRs (30d)
12

Description

**Describe the bug**
Seemingly since v.2.3.3 I occasionally see the below error when running Testrun. The below occurred following completion of one test, and just prior to running another (so a relatively low 'busy time'). Unsure whether some threshold/tolerance needs increasing somewhere and/or whether the below should be suppressed?

```
May 21 09:26:37 validator DEBUG Stopping validator
May 21 09:26:37 validator DEBUG Stopping devices
May 21 09:26:37 validator DEBUG Validator stopped
May 21 09:26:37 net_orc INFO Stopping network services
May 21 09:26:37 net_orc DEBUG Stopping network container tr-ct-gateway
May 21 09:26:38 net_orc DEBUG Stopping network container tr-ct-dns
May 21 09:26:38 net_orc DEBUG Stopping network container tr-ct-radius
May 21 09:26:38 net_orc DEBUG Stopping network container tr-ct-dhcp-1
May 21 09:26:38 net_orc DEBUG Stopping network container tr-ct-ntp
May 21 09:26:38 net_orc DEBUG Stopping network container tr-ct-host
May 21 09:26:38 net_orc DEBUG Stopping network container tr-ct-dhcp-2
May 21 09:26:38 net_orc INFO Clearing baseline network
May 21 09:26:38 ovs_ctrl DEBUG Restoring network...
May 21 09:26:38 ovs_ctrl DEBUG Deleting OVS Bridge: tr-d
May 21 09:26:38 ovs_ctrl DEBUG Deleting OVS Bridge: tr-c
May 21 09:26:38 ovs_ctrl DEBUG Network is restored
May 21 09:26:38 net_orc INFO Network is restored
Run time of job "NetworkOrchestrator.network_adapters_checker (trigger: interval[0:00:05], next run at: 2026-05-21 09:26:41 BST)" was missed by 0:00:02.358877
May 21 09:26:56 api DEBUG Received start command
May 21 09:26:56 api INFO Starting Testrun with device target iSMA iSMA-B-MIX18-IP with MAC address 00:1e:c0:fc:7d:d5
May 21 09:26:56 net_orc DEBUG Starting network orchestrator
May 21 09:26:56 net_orc DEBUG Loading network modules from /modules/network
May 21 09:26:56 net_orc INFO Loaded the following network modules:
May 21 09:26:56 validator DEBUG Stopping validator
May 21 09:26:56 validator DEBUG Stopping devices
May 21 09:26:56 validator DEBUG Validator stopped
May 21 09:26:56 net_orc INFO Stopping network services
May 21 09:26:56 net_orc DEBUG Stopping network container tr-ct-gateway
May 21 09:26:56 net_orc DEBUG Stopping network container tr-ct-dns
May 21 09:26:56 net_orc DEBUG Stopping network container tr-ct-radius
May 21 09:26:56 net_orc DEBUG Stopping network container tr-ct-dhcp-1
May 21 09:26:56 net_orc DEBUG Stopping network container tr-ct-ntp
May 21 09:26:56 net_orc DEBUG Stopping network container tr-ct-host
May 21 09:26:56 net_orc DEBUG Stopping network container tr-ct-dhcp-2
May 21 09:26:56 net_orc INFO Clearing baseline network
```

**Environment (please provide the following information about your setup):**
- Version 2.3.3

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.