VM randomly loses network
- Dominant language
- Go
- Stars
- 21.9k
- Forks
- 957
- Avg merge
- 2d 6h
- Merged PRs (30d)
- 53
Description
Using lima on a mac m1 to run ubuntu I experience a random loss of networking. Ssh shell (lima shell) stops reacting and new connection cannot be initiated.
Connecting minicom to serial port I see that the VM is alive and well - but cannot connect to any outside network.
This can be fixed by restarting, but it's obviously a huge nuisance.
It works fine usually for a few hours/days. But sometimes it breaks after as little as few minutes making lima unusable.
I can't see anything useful in logs...
On host I see:
```Klements-MacBook-Air:default ksekera$ tail -n 10 ha.stderr.log
{"level":"info","msg":"Forwarding TCP from 127.0.0.1:49579 to 127.0.0.1:49579","time":"2021-12-02T16:24:30+01:00"}
{"level":"debug","msg":"guest agent event: {Time:2021-12-02 15:25:30.599352009 +0000 UTC LocalPortsAdded:[{IP:127.0.0.1 Port:46295}] LocalPortsRemoved:[{IP:127.0.0.1 Port:49579}] Errors:[]}","time":"2021-12-02T16:25:30+01:00"}
{"level":"info","msg":"Stopping forwarding TCP from 127.0.0.1:49579 to 127.0.0.1:49579","time":"2021-12-02T16:25:30+01:00"}
{"level":"info","msg":"Forwarding TCP from 127.0.0.1:46295 to 127.0.0.1:46295","time":"2021-12-02T16:25:30+01:00"}
{"level":"debug","msg":"guest agent event: {Time:2021-12-02 15:26:36.598998341 +0000 UTC LocalPortsAdded:[{IP:127.0.0.1 Port:51547}] LocalPortsRemoved:[{IP:127.0.0.1 Port:46295}] Errors:[]}","time":"2021-12-02T16:26:36+01:00"}
{"level":"info","msg":"Stopping forwarding TCP from 127.0.0.1:46295 to 127.0.0.1:46295","time":"2021-12-02T16:26:36+01:00"}
{"level":"info","msg":"Forwarding TCP from 127.0.0.1:51547 to 127.0.0.1:51547","time":"2021-12-02T16:26:36+01:00"}
{"level":"debug","msg":"guest agent event: {Time:2021-12-02 15:27:45.597700905 +0000 UTC LocalPortsAdded:[{IP:127.0.0.1 Port:51531}] LocalPortsRemoved:[{IP:127.0.0.1 Port:51547}] Errors:[]}","time":"2021-12-02T16:27:45+01:00"}
{"level":"info","msg":"Stopping forwarding TCP from 127.0.0.1:51547 to 127.0.0.1:51547","time":"2021-12-02T16:27:45+01:00"}
{"level":"info","msg":"Forwarding TCP from 127.0.0.1:51531 to 127.0.0.1:51531","time":"2021-12-02T16:27:45+01:00"}
Klements-MacBook-Air:default ksekera$ tail -n 10 ha.stdout.log
{"time":"2021-12-01T15:06:16.235918+01:00","status":{"sshLocalPort":60022}}
{"time":"2021-12-01T15:06:36.632905+01:00","status":{"running":true,"sshLocalPort":60022}}
Klements-MacBook-Air:default ksekera$ netstat -rn
Routing tables
Internet:
Destination Gateway Flags Netif Expire
default 10.0.0.1 UGScg en8
default 10.0.0.1 UGScIg en0
10/24 link#20 UCS en8 !
10/24 link#11 UCSI en0 !
10.0.0.1/32 link#20 UCS en8 !
10.0.0.1 18:de:d7:72:da:e0 UHLWIir en0 1112
10.0.0.1/32 link#11 UCSI en0 !
10.0.0.1 18:de:d7:72:da:e0 UHLWIir en8 1179
10.0.0.2/32 link#20 UCS en8 !
10.0.0.6 8:60:6e:e7:84:72 UHLWIi en0 1182
10.0.0.6 link#20 UHLWIi en8 !
10.0.0.7 f0:18:98:43:48:7a UHLWI en0 763
10.0.0.7 f0:18:98:43:48:7a UHLWI en8 763
10.0.0.8/32 link#11 UCS en0 !
10.0.0.28 f0:f6:c1:70:b6:9a UHLWI en0 !
10.0.0.28 f0:f6:c1:70:b6:9a UHLWI en8 !
10.0.0.37 28:ee:52:60:cf:58 UHLWI en0 1169
10.0.0.37 28:ee:52:60:cf:58 UHLWI en8 1186
10.0.0.38 32:94:99:d9:65:1e UHLWI en0 234
10.0.0.38 32:94:99:d9:65:1e UHLWIi en8 1100
10.0.0.255 ff:ff:ff:ff:ff:ff UHLWbI en8 !
127 127.0.0.1 UCS lo0
127.0.0.1 127.0.0.1 UH lo0
169.254 link#20 UCS en8 !
169.254 link#11 UCSI en0 !
224.0.0/4 link#20 UmCS en8 !
224.0.0/4 link#11 UmCSI en0 !
224.0.0.251 1:0:5e:0:0:fb UHmLWI en0
224.0.0.251 1:0:5e:0:0:fb UHmLWI en8
255.255.255.255/32 link#20 UCS en8 !
255.255.255.255/32 link#11 UCSI en0 !
255.255.255.255 ff:ff:ff:ff:ff:ff UHLWbI en8 !
Internet6:
Destination Gateway Flags Netif Expire
default fe80::1%en0 UGcIg en0
default fe80::%utun0 UGcIg utun0
default fe80::%utun1 UGcIg utun1
default fe80::%utun2 UGcIg utun2
default fe80::%utun3 UGcIg utun3
default fe80::%utun4 UGcIg utun4
default fe80::1%en8 UGcIg en8
::1 ::1 UHL lo0
fe80::%lo0/64 fe80::1%lo0 UcI lo0
fe80::1%lo0 link#1 UHLI lo0
fe80::%anpi1/64 link#4 UCI anpi1
fe80::b434:14ff:fe6c:2239%anpi1 b6:34:14:6c:22:39 UHLI lo0
fe80::%anpi0/64 link#5 UCI anpi0
fe80::b434:14ff:fe6c:2238%anpi0 b6:34:14:6c:22:38 UHLI lo0
fe80::%en0/64 link#11 UCI en0
fe80::1%en0 18:de:d7:72:da:e0 UHLWIr en0
fe80::6f:be67:640b:5efc%en0 18:3e:ef:d5:66:83 UHLI lo0
fe80::225:36ff:fe61:a089%en0 0:25:36:61:a0:89 UHLWI en0
fe80::87e:64b7:ecd0:f3f5%en0 32:94:99:d9:65:1e UHLWIi en0
fe80::%awdl0/64 link#12 UCI awdl0
fe80::cbd:42ff:fea7:6b6d%awdl0 e:bd:42:a7:6b:6d UHLI lo0
fe80::%llw0/64 link#13 UCI llw0
fe80::cbd:42ff:fea7:6b6d%llw0 e:bd:42:a7:6b:6d UHLI lo0
fe80::%utun0/64 fe80::f4b4:2ecd:14f9:dd98%utun0 UcI utun0
fe80::f4b4:2ecd:14f9:dd98%utun0 link#15 UHLI lo0
fe80::%utun1/64 fe80::56c:5d1e:5198:63d7%utun1 UcI utun1
fe80::56c:5d1e:5198:63d7%utun1 link#16 UHLI lo0
fe80::%utun2/64 fe80::ce81:b1c:bd2c:69e%utun2 UcI utun2
fe80::ce81:b1c:bd2c:69e%utun2 link#17 UHLI lo0
fe80::%utun3/64 fe80::4ce6:1cc6:a0fe:d5f6%utun3 UcI utun3
fe80::4ce6:1cc6:a0fe:d5f6%utun3 link#18 UHLI lo0
fe80::%utun4/64 fe80::5b54:2c4d:2a19:9faa%utun4 UcI utun4
fe80::5b54:2c4d:2a19:9faa%utun4 link#19 UHLI lo0
fe80::%en8/64 link#20 UCI en8
fe80::1%en8 18:de:d7:72:da:e0 UHLWIr en8
fe80::6e:f638:e37a:5e00%en8 f0:18:98:43:48:7a UHLWI en8
fe80::225:36ff:fe61:a089%en8 0:25:36:61:a0:89 UHLWI en8
fe80::87e:64b7:ecd0:f3f5%en8 32:94:99:d9:65:1e UHLWI en8
fe80::c76:6c2:9bfe:dddd%en8 34:99:71:d5:1c:61 UHLI lo0
ff00::/8 ::1 UmCI lo0
ff00::/8 link#4 UmCI anpi1
ff00::/8 link#5 UmCI anpi0
ff00::/8 link#11 UmCI en0
ff00::/8 link#12 UmCI awdl0
ff00::/8 link#13 UmCI llw0
ff00::/8 fe80::f4b4:2ecd:14f9:dd98%utun0 UmCI utun0
ff00::/8 fe80::56c:5d1e:5198:63d7%utun1 UmCI utun1
ff00::/8 fe80::ce81:b1c:bd2c:69e%utun2 UmCI utun2
ff00::/8 fe80::4ce6:1cc6:a0fe:d5f6%utun3 UmCI utun3
ff00::/8 fe80::5b54:2c4d:2a19:9faa%utun4 UmCI utun4
ff00::/8 link#20 UmCI en8
ff01::%lo0/32 ::1 UmCI lo0
ff01::%anpi1/32 link#4 UmCI anpi1
ff01::%anpi0/32 link#5 UmCI anpi0
ff01::%en0/32 link#11 UmCI en0
ff01::%awdl0/32 link#12 UmCI awdl0
ff01::%llw0/32 link#13 UmCI llw0
ff01::%utun0/32 fe80::f4b4:2ecd:14f9:dd98%utun0 UmCI utun0
ff01::%utun1/32 fe80::56c:5d1e:5198:63d7%utun1 UmCI utun1
ff01::%utun2/32 fe80::ce81:b1c:bd2c:69e%utun2 UmCI utun2
ff01::%utun3/32 fe80::4ce6:1cc6:a0fe:d5f6%utun3 UmCI utun3
ff01::%utun4/32 fe80::5b54:2c4d:2a19:9faa%utun4 UmCI utun4
ff01::%en8/32 link#20 UmCI en8
ff02::%lo0/32 ::1 UmCI lo0
ff02::%anpi1/32 link#4 UmCI anpi1
ff02::%anpi0/32 link#5 UmCI anpi0
ff02::%en0/32 link#11 UmCI en0
ff02::%awdl0/32 link#12 UmCI awdl0
ff02::%llw0/32 link#13 UmCI llw0
ff02::%utun0/32 fe80::f4b4:2ecd:14f9:dd98%utun0 UmCI utun0
ff02::%utun1/32 fe80::56c:5d1e:5198:63d7%utun1 UmCI utun1
ff02::%utun2/32 fe80::ce81:b1c:bd2c:69e%utun2 UmCI utun2
ff02::%utun3/32 fe80::4ce6:1cc6:a0fe:d5f6%utun3 UmCI utun3
ff02::%utun4/32 fe80::5b54:2c4d:2a19:9faa%utun4 UmCI utun4
ff02::%en8/32 link#20 UmCI en8
Klements-MacBook-Air:default ksekera$ ifconfig | grep "inet"
inet 127.0.0.1 netmask 0xff000000
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1
inet6 fe80::b434:14ff:fe6c:2239%anpi1 prefixlen 64 scopeid 0x4
inet6 fe80::b434:14ff:fe6c:2238%anpi0 prefixlen 64 scopeid 0x5
inet6 fe80::6f:be67:640b:5efc%en0 prefixlen 64 secured scopeid 0xb
inet 10.0.0.8 netmask 0xffffff00 broadcast 10.0.0.255
inet6 fe80::cbd:42ff:fea7:6b6d%awdl0 prefixlen 64 scopeid 0xc
inet6 fe80::cbd:42ff:fea7:6b6d%llw0 prefixlen 64 scopeid 0xd
inet6 fe80::f4b4:2ecd:14f9:dd98%utun0 prefixlen 64 scopeid 0xf
inet6 fe80::56c:5d1e:5198:63d7%utun1 prefixlen 64 scopeid 0x10
inet6 fe80::ce81:b1c:bd2c:69e%utun2 prefixlen 64 scopeid 0x11
inet6 fe80::4ce6:1cc6:a0fe:d5f6%utun3 prefixlen 64 scopeid 0x12
inet6 fe80::5b54:2c4d:2a19:9faa%utun4 prefixlen 64 scopeid 0x13
inet6 fe80::c76:6c2:9bfe:dddd%en8 prefixlen 64 secured scopeid 0x14
inet 10.0.0.2 netmask 0xffffff00 broadcast 10.0.0.255
```
On VM I see:
```
ksekera@lima-default ~> ip addr show
1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: mtu 1500 qdisc fq_codel state UP group default qlen 1000
link/ether 52:55:55:a9:77:b3 brd ff:ff:ff:ff:ff:ff
inet 192.168.5.15/24 brd 192.168.5.255 scope global dynamic eth0
valid_lft 69468sec preferred_lft 69468sec
inet6 fec0::5055:55ff:fea9:77b3/64 scope site dynamic mngtmpaddr noprefixroute
valid_lft 85525sec preferred_lft 13525sec
inet6 fe80::5055:55ff:fea9:77b3/64 scope link
valid_lft forever preferred_lft forever
ksekera@lima-default ~> ip link show
1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eth0: mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 1000
link/ether 52:55:55:a9:77:b3 brd ff:ff:ff:ff:ff:ff
ksekera@lima-default ~> ip route show
default via 192.168.5.2 dev eth0 proto dhcp src 192.168.5.15 metric 100
192.168.5.0/24 dev eth0 proto kernel scope link src 192.168.5.15
192.168.5.2 dev eth0 proto dhcp scope link src 192.168.5.15 metric 100
ksekera@lima-default ~> ping 192.168.5.2
PING 192.168.5.2 (192.168.5.2) 56(84) bytes of data.
^C
--- 192.168.5.2 ping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 2034ms
```
Contributor guide
Assessment
This issue has not been assessed yet.