CSCfi / CSCfi/airflow-openshift

Redis and Postgres not working on OKD 4.6

Open
#11 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
14
Forks
12
PR merge metrics
No merged PRs in 30d

Description

We are using OKD 4.6, but it is impossible to use this template Airflow because Redis and Postgres are crashing directly

* Postgresql is in a `CrashLoopBackOff` with those logs (wow we got logs this time! Thanks OpenShift)
```
pg_ctl: another server might be running; trying to start server anyway
waiting for server to start....2021-08-24 11:51:54.167 UTC [25] LOG: starting PostgreSQL 12.5 on x86_64-redhat-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-44), 64-bit
2021-08-24 11:51:54.168 UTC [25] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
2021-08-24 11:51:54.171 UTC [25] LOG: listening on Unix socket "/tmp/.s.PGSQL.5432"
2021-08-24 11:51:54.199 UTC [25] LOG: redirecting log output to logging collector process
2021-08-24 11:51:54.199 UTC [25] HINT: Future log output will appear in directory "log".
............ done
server started
/var/run/postgresql:5432 - accepting connections
=> sourcing /usr/share/container-scripts/postgresql/start/set_passwords.sh ...
ERROR: role "userLHV5S" does not exist
```

* Redis is just "Scaling up" without showing any single event nor logs (the usual OpenShift mess where a deployment just don't want to start, but OpenShift is not reporting anything anywhere)

* Note that I am also having this problem: https://github.com/CSCfi/airflow-openshift/issues/10 when starting new-app from the terminal with `oc new-app`

Normally Redis and Postgres are fairly regular services to deploy on OpenShift (it exists number of operators/template)

Would it be possible to reuse an existing working deployments for those 2 commons databases? Instead of rewriting the whole deployment from scratch in the template

Another option would be to start Airflow using the official Helm chart here: https://github.com/airflow-helm/charts/tree/main/charts/airflow

Anyone got experience on which configuration needs to be added to this chart to make it work on OpenShift?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.