mayadata-io / mayadata-io/ci-e2e-dashboard

Openebs.ci postgresql pod went crashloop backoff

Open
#255 0 comments 0 reactions 1 assignee View on GitHub

@atulabhi is already working on this.

Since Dec 30, 2019.

Dominant language
TypeScript
Stars
7
Forks
7
PR merge metrics
No merged PRs in 30d

Description

What happened:

Some times postgresql pod went crashloopbackoff .

Platform :
GCP

logs of postgresql pod :

Working on primary...
+ case "$PG_MODE" in
+ echo 'Working on primary...'
+ initialize_primary
+ echo initialize_primary
initialize_primary
+ '[' '!' -f /pgdata/postgresql-0/postgresql.conf ']'
+ '[' -f /pgconf/postgresql.conf ']'
+ date
+ postgres -D /pgdata/postgresql-0
Mon Dec 30 07:10:50 UTC 2019
+ [[ -v PGAUDIT_ANALYZE ]]
+ wait
2019-12-30 02:10:50 EST [40]: [1-1] user=,db=,app=,client=FATAL:  could not remove old lock file "postmaster.pid": Read-only file system
2019-12-30 02:10:50 EST [40]: [2-1] user=,db=,app=,client=HINT:  The file seems accidentally left over, but it could not be removed. Please remove the file by hand and try again.
Exiting...at end
+ echo 'Exiting...at end

cstor pool pod also went to crashloopbackoff state in openebs namespace

logs :

W1230 07:13:17.948706       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:20.952801       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:23.956290       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:26.959823       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:29.963835       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:32.967654       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:35.971751       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:38.974637       1 pool.go:54] Failed to get zpool status, error: exit status 1, pool container may be initializing,  retry after 2s
W1230 07:13:40.978918       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:43.982456       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:46.986487       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:49.990016       1 pool.go:60] No pool available, pool must be creating, retry after 3s

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.