moby / moby/libnetwork

There are deleteSvcRecords in the log, what is the problem?

Open
#2,323 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
2.2k
Forks
875
No merged PRs in 30d

Description

There are deleteSvcRecords in the log, what is the problem? Explain that the container has been deleted?
log:

Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.001493581+08:00" level=debug msg="Calling GET /tasks?"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.638117272+08:00" level=debug msg="Client context cancelled, stop sending events"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44+08:00" level=debug msg="event published" module="containerd/events" ns=moby topic="/tasks/exit" type=containerd.events.TaskExit
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.671042291+08:00" level=debug msg=event module=libcontainerd namespace=moby topic=/tasks/exit
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44+08:00" level=info msg="shim reaped" id=96df3031078874ab1547ae2ef047fd172091f2338d53e8fd6218cb12a7537443 module="containerd/tasks"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44+08:00" level=debug msg="event published" module="containerd/tasks" ns=moby topic="/tasks/delete" type=containerd.events.TaskDelete
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.721632550+08:00" level=debug msg=event module=libcontainerd namespace=moby topic=/tasks/delete
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.721666205+08:00" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.722069182+08:00" level=debug msg="Revoking external connectivity on endpoint dce_swarm-manager_1 (e23f6d17b660b4b23dd4bf0b9c062741bb781e80b748d60e7f7f6494d0de8078)"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.722835819+08:00" level=debug msg="Calling GET /v1.25/containers/json?all=1&filters=%7B%22id%22%3A%7B%2296df3031078874ab1547ae2ef047fd172091f2338d53e8fd6218cb12a7537443%22%3Atrue%7D%7D&limit=0"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.722950184+08:00" level=debug msg="Calling GET /v1.25/containers/json?all=1&filters=%7B%22id%22%3A%7B%2296df3031078874ab1547ae2ef047fd172091f2338d53e8fd6218cb12a7537443%22%3Atrue%7D%7D&limit=0"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.723270071+08:00" level=debug msg="/usr/sbin/iptables, [--wait -t nat -C DOCKER -p tcp -d 0/0 --dport 2375 -j DNAT --to-destination 172.19.0.4:2375 ! -i br-9563a4ded9d9]"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.724329445+08:00" level=debug msg="Calling GET /v1.25/containers/96df3031078874ab1547ae2ef047fd172091f2338d53e8fd6218cb12a7537443/json"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.724818339+08:00" level=debug msg="Calling GET /v1.25/containers/96df3031078874ab1547ae2ef047fd172091f2338d53e8fd6218cb12a7537443/json"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.735172908+08:00" level=debug msg="/usr/sbin/iptables, [--wait -t nat -D DOCKER -p tcp -d 0/0 --dport 2375 -j DNAT --to-destination 172.19.0.4:2375 ! -i br-9563a4ded9d9]"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.724329445+08:00" level=debug msg="Calling GET /v1.25/containers/96df3031078874ab1547ae2ef047fd172091f2338d53e8fd6218cb12a7537443/json"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.724818339+08:00" level=debug msg="Calling GET /v1.25/containers/96df3031078874ab1547ae2ef047fd172091f2338d53e8fd6218cb12a7537443/json"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.735172908+08:00" level=debug msg="/usr/sbin/iptables, [--wait -t nat -D DOCKER -p tcp -d 0/0 --dport 2375 -j DNAT --to-destination 172.19.0.4:2375 ! -i br-9563a4ded9d9]"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.737276650+08:00" level=debug msg="/usr/sbin/iptables, [--wait -t filter -C DOCKER ! -i br-9563a4ded9d9 -o br-9563a4ded9d9 -p tcp -d 172.19.0.4 --dport 2375 -j ACCEPT]"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.739087352+08:00" level=debug msg="/usr/sbin/iptables, [--wait -t filter -D DOCKER ! -i br-9563a4ded9d9 -o br-9563a4ded9d9 -p tcp -d 172.19.0.4 --dport 2375 -j ACCEPT]"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.741298701+08:00" level=debug msg="/usr/sbin/iptables, [--wait -t nat -C POSTROUTING -p tcp -s 172.19.0.4 -d 172.19.0.4 --dport 2375 -j MASQUERADE]"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.743237860+08:00" level=debug msg="/usr/sbin/iptables, [--wait -t nat -D POSTROUTING -p tcp -s 172.19.0.4 -d 172.19.0.4 --dport 2375 -j MASQUERADE]"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.779550026+08:00" level=debug msg="DeleteConntrackEntries purged ipv4:183, ipv6:0"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.813233007+08:00" level=debug msg="e23f6d17b660b4b23dd4bf0b9c062741bb781e80b748d60e7f7f6494d0de8078 (9563a4d).deleteSvcRecords(dce_swarm-manager_1, 172.19.0.4, <nil>, true) updateSvcRecord sid:e23f6d17b660b4b23dd4bf0b9c062741bb781e80b748d60e7f7f6494d0de8078 "
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.813328688+08:00" level=debug msg="e23f6d17b660b4b23dd4bf0b9c062741bb781e80b748d60e7f7f6494d0de8078 (9563a4d).deleteSvcRecords(96df30310788, 172.19.0.4, <nil>, false) updateSvcRecord sid:e23f6d17b660b4b23dd4bf0b9c062741bb781e80b748d60e7f7f6494d0de8078 "
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.816235143+08:00" level=debug msg="Calling GET /nodes?"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.849767515+08:00" level=debug msg="Releasing addresses for endpoint dce_swarm-manager_1's interface on network dce_default"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.849820518+08:00" level=debug msg="ReleaseAddress(LocalDefault/172.19.0.0/16, 172.19.0.4)"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.849853297+08:00" level=debug msg="Received set for ordinal 4, start 0, end 0, any false, release true, serial:false curr:5 \n"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44+08:00" level=debug msg="event published" module="containerd/containers" ns=moby topic="/containers/delete" type=containerd.events.ContainerDelete
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.915861894+08:00" level=debug msg="Calling GET /v1.25/networks/9563a4ded9d9e59d7cccf24715f5f69aa9bce22800aae380b8c790ca9fb7342d"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.916134967+08:00" level=debug msg="Calling GET /v1.25/networks/9563a4ded9d9e59d7cccf24715f5f69aa9bce22800aae380b8c790ca9fb7342d"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.917705643+08:00" level=debug msg="Calling GET /v1.25/volumes/335449e2741c983581cd1dfdff2c9ca3948ae6535fb0cab873c6be445cff7a84"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.917726110+08:00" level=debug msg="Calling GET /v1.25/volumes/335449e2741c983581cd1dfdff2c9ca3948ae6535fb0cab873c6be445cff7a84"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.917804463+08:00" level=debug msg="Calling GET /containers/96df3031078874ab1547ae2ef047fd172091f2338d53e8fd6218cb12a7537443/stats?stream=false"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.918225762+08:00" level=debug msg="Calling GET /containers/11c55599e26fad09c7a75fc8b5631d7d6a25d425352819574e76e51cb3fc5161/stats?stream=false"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.919377286+08:00" level=debug msg="Calling GET /containers/3798f5ba919af80c8b444656cc3fec035bb4d62e20b64916ec95a2a058b87a14/stats?stream=false"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.920495322+08:00" level=debug msg="Calling GET /containers/7078eb2a50da383b64d7bb4c0417eb2f56878d000e8016310ec35a545548b4da/stats?stream=false"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.922402687+08:00" level=debug msg="Calling GET /containers/a19685e53ff56987e9e875e5ec4563ad4bf55cb37ed818b0fbe6af27eadd2b1f/stats?stream=false"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.933603595+08:00" level=debug msg="Calling GET /containers/7fec5d8c790e12f5e580deb11d1407f31f7048195de6b9a8dee35b3403c10ecc/stats?stream=false"
Jan 09 20:29:44 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:44.933646789+08:00" level=debug msg="Calling GET /containers/03fb7e13b9ada8aa4bc15115a7f4056b953dd8a36cf18bc722cd2276b963e60f/stats?stream=false"
Jan 09 20:29:45 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:45.390726025+08:00" level=debug msg="service-prd98-10(e4db7d80a9f2): Initiating bulk sync with node 0e050c47b5fc"
Jan 09 20:29:45 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:45.390848829+08:00" level=debug msg="service-prd98-10(e4db7d80a9f2): Initiating unsolicited bulk sync for networks [oid2ndq2acwe3waqdwiyz8qxi 31715e9gadxlju8bji34eomqa] with node 0e050c47b5fc"
Jan 09 20:29:45 service-prd98-10 dockerd[8231]: time="2019-01-09T20:29:45.416038518+08:00" level=debug msg="memberlist: Stream connection from=10.133.98.45:35814"

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing the deleteSvcRecords log entries alongside the containerd task and container delete events shown in the report. Determine whether these messages represent normal cleanup or an error, then document what the sequence means and whether it indicates that the container was deleted.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, go
Domain
documentation, networking
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.