GoogleCloudPlatform / GoogleCloudPlatform/konlet

Restarting VMs running konlet stops logging to Stackdriver

Open
#65 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
88
Forks
24
PR merge metrics
No merged PRs in 30d

Description

The named docker container for the logging agent is still around, preventing the agent from starting after the VM is restarted.

```
Oct 16 16:34:24 alpha-relay-kmrj systemd[1]: stackdriver-logging.service: Service RestartSec=10s expired, scheduling restart.
Oct 16 16:34:24 alpha-relay-kmrj systemd[1]: stackdriver-logging.service: Scheduled restart job, restart counter is at 54.
Oct 16 16:34:24 alpha-relay-kmrj systemd[1]: Stopped Fluentd container for Stackdriver Logging.
Oct 16 16:34:24 alpha-relay-kmrj systemd[1]: stackdriver-logging.service: Consumed 58ms CPU time
Oct 16 16:34:24 alpha-relay-kmrj systemd[1]: Starting Fluentd container for Stackdriver Logging...
Oct 16 16:34:24 alpha-relay-kmrj systemd[1]: Started Fluentd container for Stackdriver Logging.
Oct 16 16:34:24 alpha-relay-kmrj docker[1742]: /usr/bin/docker: Error response from daemon: Conflict. The container name "/stackdriver-logging-agent" is already in use by container "7cf099e84bd1841100c8718df32f6bbb9c78897a0f42b7c2b1e0e92175711dd0". You have to remove (or rename) that container to be able to reuse that name.
Oct 16 16:34:24 alpha-relay-kmrj docker[1742]: See '/usr/bin/docker run --help'.
Oct 16 16:34:24 alpha-relay-kmrj systemd[1]: stackdriver-logging.service: Main process exited, code=exited, status=125/n/a
Oct 16 16:34:24 alpha-relay-kmrj systemd[1]: stackdriver-logging.service: Failed with result 'exit-code'.
Oct 16 16:34:24 alpha-relay-kmrj systemd[1]: stackdriver-logging.service: Consumed 56ms CPU time
```

Contributor guide

Open the contributing guide

Research direction

No source file or test is named. Start by tracing how VM restarts manage the Stackdriver logging service and its named Docker container; done means the logging agent starts successfully and resumes logging after a VM restart.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, go, google-cloud
Domain
cloud, devops, infrastructure, observability
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.