Kubernetes deployment not working as expected, fatal errors about hbd cron_events and metadata after some time

### Version Information

Server Version:
2.12.0

### Environment

Digital ocean kubernetes cluster

### What is the current behaviour?

Hey all, I have hasura deployed on a digital ocean kubernetes cluster. I am not sure if this is truly a bug but im looking for some guidance here as a long time hasura user. Whenever the deployment's pod's are first created, everything works as expected with auto migrations via the docker cli migrations image but after some time it seems like it loses the volume its looking at or something gets out of sync as it starts just logging fatal errors over and over again:

Also noticing whenever it gets into this state even while dismissing the "opt out of pre-release" notifications I get this: Internal error: missing hasura_uuid

```
{"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T18:37:42.254+0000","type":"scheduled-trigger"}
```

```
{"detail":{"info":{"error":{"info":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_metadata\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n SELECT resource_version from hdb_catalog.hdb_metadata\n "},"path":"$"},"type":"query_error"}},"thread_type":"listener"},"level":"error","timestamp":"2022-10-03T17:09:39.924+0000","type":"schema-sync-thread"}
```

### What is the expected behaviour?

For it to work as it does on startup.

### How to reproduce the issue?

1.
2.
3.

### Please provide any traces or logs that could help here.

```
2022-10-03T15:37:44.396714002Z {"timestamp":"2022-10-03T15:37:44.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-startup","info":"migrations server port env var is not set, defaulting to 9691"}}
2022-10-03T15:37:44.397680558Z {"timestamp":"2022-10-03T15:37:44.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-startup","info":"starting graphql engine temporarily on port 9691"}}
2022-10-03T15:37:44.401466765Z {"timestamp":"2022-10-03T15:37:44.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-startup","info":"waiting 5 for 9691 to be ready"}}
2022-10-03T15:37:44.836775366Z {"detail":{"info":{"admin_secret_set":true,"auth_hook":null,"auth_hook_mode":null,"console_assets_dir":null,"cors_config":{"allowed_origins":"*","disabled":false,"ws_read_cookie":null},"enable_allowlist":false,"enable_console":true,"enable_maintenance_mode":false,"enable_metadata_query_logging":false,"enable_telemetry":true,"enabled_apis":["metadata"],"enabled_log_types":["startup","webhook-log","http-log","websocket-log"],"events_fetch_batch_size":100,"experimental_features":[],"graceful_shutdown_timeout":60,"infer_function_permissions":true,"jwt_secret":[],"live_query_options":{"batch_size":100,"refetch_delay":1},"log_level":"info","port":9691,"remote_schema_permissions":false,"server_host":"HostAny","stringify_numeric_types":false,"transaction_isolation":"ISOLATION LEVEL READ COMMITTED","unauth_role":null,"use_prepared_statements":true,"v1-boolean-null-collapse":false,"websocket_compression_options":"NoCompression","websocket_connection_init_timeout":"Seconds {seconds = 3s}","websocket_keep_alive":"KeepAliveDelay {unKeepAliveDelay = Seconds {seconds = 5s}}"},"kind":"server_configuration"},"level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"startup"}
2022-10-03T15:37:44.836813428Z {"detail":{"info":{"database_url":"postgres://postgres:...@postgres-service:5432/r2pos","retries":3},"kind":"postgres_connection"},"level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"startup"}
2022-10-03T15:37:45.408237705Z {"timestamp":"2022-10-03T15:37:45.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-startup","info":"port 9691 is ready"}}
2022-10-03T15:37:45.409164601Z {"timestamp":"2022-10-03T15:37:45.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-startup","info":"env var HASURA_GRAPHQL_MIGRATIONS_DIR is not set, defaulting to /hasura-migrations"}}
2022-10-03T15:37:45.410041773Z {"timestamp":"2022-10-03T15:37:45.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-startup","info":"env var HASURA_GRAPHQL_METADATA_DIR is not set, defaulting to /hasura-metadata"}}
2022-10-03T15:37:45.411863475Z {"timestamp":"2022-10-03T15:37:45.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-apply","info":"applying metadata from /hasura-metadata"}}
2022-10-03T15:37:45.841380392Z {"detail":"Thread ourIdleGC (re)started","level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.841423245Z {"detail":"Thread processEventQueue (re)started","level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.841427792Z {"detail":"Thread checkForUpdates (re)started","level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.841431284Z {"detail":"Thread asyncActionsProcessor (re)started","level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.841436314Z {"detail":"Thread asyncActionSubscriptionsProcessor (re)started","level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.841444862Z {"detail":{"info":"Already at the latest catalog version (47); nothing to do.","kind":"catalog_migrate"},"level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"startup"}
2022-10-03T15:37:45.841456033Z {"detail":{"info":"Schema sync enabled. Polling at Milliseconds {milliseconds = 1s}","kind":"schema-sync"},"level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"startup"}
2022-10-03T15:37:45.841480842Z {"detail":{"info":{"instance_id":"c1acfae2-3a89-4241-ab7a-bd2aac3b4b65","message":"listener thread started","thread_id":"ThreadId 44"},"kind":"schema-sync"},"level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"startup"}
2022-10-03T15:37:45.841511795Z {"detail":"The following environment variables are deprecated and moved to metadata: HASURA_GRAPHQL_NO_OF_RETRIES","level":"warn","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.841518895Z {"detail":{"info":{"instance_id":"c1acfae2-3a89-4241-ab7a-bd2aac3b4b65","message":"processor thread started","thread_id":"ThreadId 59"},"kind":"schema-sync"},"level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"startup"}
2022-10-03T15:37:45.841523384Z {"detail":{"info":"starting workers","kind":"event_triggers"},"level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"startup"}
2022-10-03T15:37:45.841527960Z {"detail":{"info":"preparing data","kind":"scheduled_triggers"},"level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"startup"}
2022-10-03T15:37:45.841532394Z {"detail":{"info":"Help us improve Hasura! The graphql-engine server collects anonymized usage stats which allows us to keep improving Hasura at warp speed. To read more or opt-out, visit https://hasura.io/docs/latest/graphql/core/guides/telemetry.html","kind":"telemetry"},"level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"startup"}
2022-10-03T15:37:45.841540806Z {"detail":{"info":{"message":"starting API server","time_taken":0.532893014},"kind":"server"},"level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"startup"}
2022-10-03T15:37:45.841545685Z {"detail":"Thread SchemeUpdate.listener (re)started","level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.841550338Z {"detail":"Thread SchemeUpdate.processor (re)started","level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.841554724Z {"detail":"Thread runCronEventsGenerator (re)started","level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.841559972Z {"detail":"Thread processScheduledTriggers (re)started","level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.841564688Z {"detail":"Thread runTelemetry (re)started","level":"info","timestamp":"2022-10-03T15:37:44.836+0000","type":"unstructured"}
2022-10-03T15:37:45.916416025Z {"level":"info","msg":"Help us improve Hasura! The cli collects anonymized usage stats which\nallow us to keep improving Hasura at warp speed. To opt-out or read more,\nvisit https://hasura.io/docs/latest/graphql/core/guides/telemetry.html\n","time":"2022-10-03T15:37:45Z"}
2022-10-03T15:37:45.939598665Z {"level":"info","msg":"Applying metadata...","time":"2022-10-03T15:37:45Z"}
2022-10-03T15:37:46.842578096Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"127.0.0.1","method":"GET","status":200,"url":"/v1/version"},"operation":{"request_id":"c43ebbda-f9f1-44c1-b7d0-cdd40f5bedc7","request_mode":"non-graphql","response_size":16},"request_id":"c43ebbda-f9f1-44c1-b7d0-cdd40f5bedc7"},"level":"info","timestamp":"2022-10-03T15:37:45.918+0000","type":"http-log"}
2022-10-03T15:37:46.842639271Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/query"},"operation":{"query_execution_time":8.762578e-3,"request_id":"f2ba307f-2af5-4f13-bac3-0f6b72460fc3","request_mode":"non-graphql","request_read_time":1.066e-6,"response_size":1464,"user_vars":{"x-hasura-role":"admin"}},"request_id":"f2ba307f-2af5-4f13-bac3-0f6b72460fc3"},"level":"info","timestamp":"2022-10-03T15:37:45.918+0000","type":"http-log"}
2022-10-03T15:37:46.842669968Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"127.0.0.1","method":"GET","status":200,"url":"/v1/version"},"operation":{"request_id":"8c0c21c6-f060-43e1-8c91-4294d77ac725","request_mode":"non-graphql","response_size":16},"request_id":"8c0c21c6-f060-43e1-8c91-4294d77ac725"},"level":"info","timestamp":"2022-10-03T15:37:45.918+0000","type":"http-log"}
2022-10-03T15:37:46.842675524Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":5.742282e-3,"request_id":"da64ad0c-5471-4f6f-9585-09c42d4f923a","request_mode":"non-graphql","request_read_time":1.837e-6,"response_size":184,"user_vars":{"x-hasura-role":"admin"}},"request_id":"da64ad0c-5471-4f6f-9585-09c42d4f923a"},"level":"info","timestamp":"2022-10-03T15:37:45.918+0000","type":"http-log"}
2022-10-03T15:37:46.842681512Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"127.0.0.1","method":"GET","status":404,"url":"/v1alpha1/config"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"76863cbd-8a9f-449b-b5d7-3a066edaa65f","request_mode":"error","response_size":65},"request_id":"76863cbd-8a9f-449b-b5d7-3a066edaa65f"},"level":"error","timestamp":"2022-10-03T15:37:45.918+0000","type":"http-log"}
2022-10-03T15:37:46.850205783Z {"level":"info","msg":"Metadata applied","time":"2022-10-03T15:37:46Z"}
2022-10-03T15:37:47.213621258Z {"timestamp":"2022-10-03T15:37:47.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-apply","info":"applying migrations from /hasura-migrations"}}
2022-10-03T15:37:47.633799827Z {"level":"info","msg":"getting lists of databases from server ","time":"2022-10-03T15:37:47Z"}
2022-10-03T15:37:47.673060280Z {"level":"info","msg":"nothing to apply on database default","time":"2022-10-03T15:37:47Z"}
2022-10-03T15:37:47.844077143Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"127.0.0.1","method":"GET","status":404,"url":"/v1alpha1/config"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"8d4ca69c-9090-4c30-8990-3989704996c9","request_mode":"error","response_size":65},"request_id":"8d4ca69c-9090-4c30-8990-3989704996c9"},"level":"error","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:47.844119526Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":5.932835e-3,"request_id":"dc0bbca2-c6a1-4e1c-840f-5120dfefb8c5","request_mode":"non-graphql","request_read_time":1.557e-6,"response_size":184,"user_vars":{"x-hasura-role":"admin"}},"request_id":"dc0bbca2-c6a1-4e1c-840f-5120dfefb8c5"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:47.844131885Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":5.407899e-3,"request_id":"740a0679-d24f-4f75-a027-7ea37a0026a8","request_mode":"non-graphql","request_read_time":2.431e-6,"response_size":184,"user_vars":{"x-hasura-role":"admin"}},"request_id":"740a0679-d24f-4f75-a027-7ea37a0026a8"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:47.844144382Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":0.301625939,"request_id":"07f0765e-57e0-426f-a3d6-33f2ab77d0e5","request_mode":"non-graphql","request_read_time":1.24804e-4,"response_size":60,"user_vars":{"x-hasura-role":"admin"}},"request_id":"07f0765e-57e0-426f-a3d6-33f2ab77d0e5"},"level":"info","timestamp":"2022-10-03T15:37:45.918+0000","type":"http-log"}
2022-10-03T15:37:47.844163160Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":7.142393e-3,"request_id":"63219c20-a721-40c9-8c32-78ef799ca8c9","request_mode":"non-graphql","request_read_time":1.283e-6,"response_size":39,"user_vars":{"x-hasura-role":"admin"}},"request_id":"63219c20-a721-40c9-8c32-78ef799ca8c9"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:47.844167512Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"127.0.0.1","method":"GET","status":200,"url":"/v1/version"},"operation":{"request_id":"f569cd38-039f-4105-a456-dca650b14707","request_mode":"non-graphql","response_size":16},"request_id":"f569cd38-039f-4105-a456-dca650b14707"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:47.844171982Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/query"},"operation":{"query_execution_time":3.939752e-3,"request_id":"669fbe7a-f43a-4a62-8161-02ca9df04683","request_mode":"non-graphql","request_read_time":1.66e-6,"response_size":1464,"user_vars":{"x-hasura-role":"admin"}},"request_id":"669fbe7a-f43a-4a62-8161-02ca9df04683"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:47.844186467Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":3.688128e-3,"request_id":"e9e357a7-aa2d-414e-a0c3-cb1dabfc2e8f","request_mode":"non-graphql","request_read_time":1.825e-6,"response_size":1464,"user_vars":{"x-hasura-role":"admin"}},"request_id":"e9e357a7-aa2d-414e-a0c3-cb1dabfc2e8f"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:47.844202019Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":5.052324e-3,"request_id":"4210032a-6d22-40fc-ba79-8ba51949f94b","request_mode":"non-graphql","request_read_time":1.852e-6,"response_size":184,"user_vars":{"x-hasura-role":"admin"}},"request_id":"4210032a-6d22-40fc-ba79-8ba51949f94b"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:47.844206839Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"127.0.0.1","method":"GET","status":200,"url":"/v1/version"},"operation":{"request_id":"5e44b962-aff5-465c-8453-6e5fa072373c","request_mode":"non-graphql","response_size":16},"request_id":"5e44b962-aff5-465c-8453-6e5fa072373c"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:47.844210103Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":8.652832e-3,"request_id":"55b0a1dc-0f00-4ce9-917d-44f855172d88","request_mode":"non-graphql","request_read_time":2.26e-6,"response_size":184,"user_vars":{"x-hasura-role":"admin"}},"request_id":"55b0a1dc-0f00-4ce9-917d-44f855172d88"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:47.844216195Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":5.093408e-3,"request_id":"165d35c0-c4c1-48a0-bb30-774cebff57b7","request_mode":"non-graphql","request_read_time":2.162e-6,"response_size":184,"user_vars":{"x-hasura-role":"admin"}},"request_id":"165d35c0-c4c1-48a0-bb30-774cebff57b7"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:48.020306436Z {"timestamp":"2022-10-03T15:37:48.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-apply","info":"reloading metadata"}}
2022-10-03T15:37:48.434915674Z {"level":"info","msg":"Reloading metadata...","time":"2022-10-03T15:37:48Z"}
2022-10-03T15:37:48.777635380Z {"level":"info","msg":"Metadata reloaded","time":"2022-10-03T15:37:48Z"}
2022-10-03T15:37:48.781930817Z {"level":"info","msg":"Metadata is consistent","time":"2022-10-03T15:37:48Z"}
2022-10-03T15:37:48.845011554Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"127.0.0.1","method":"GET","status":200,"url":"/v1/version"},"operation":{"request_id":"4757ec1e-c658-4d91-854c-fb32dad41725","request_mode":"non-graphql","response_size":16},"request_id":"4757ec1e-c658-4d91-854c-fb32dad41725"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:48.845069314Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":0.341776118,"request_id":"8dd7a8cf-b329-422d-80c6-f89348576f51","request_mode":"non-graphql","request_read_time":1.756e-6,"response_size":60,"user_vars":{"x-hasura-role":"admin"}},"request_id":"8dd7a8cf-b329-422d-80c6-f89348576f51"},"level":"info","timestamp":"2022-10-03T15:37:48.776+0000","type":"http-log"}
2022-10-03T15:37:48.845078355Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"127.0.0.1","method":"GET","status":404,"url":"/v1alpha1/config"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"a87da419-6a09-4edb-8850-23333b3eca68","request_mode":"error","response_size":65},"request_id":"a87da419-6a09-4edb-8850-23333b3eca68"},"level":"error","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:48.845083819Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/query"},"operation":{"query_execution_time":6.150364e-3,"request_id":"f13fc013-9718-4b4e-b6d1-1ff546a57bdf","request_mode":"non-graphql","request_read_time":1.55e-6,"response_size":1464,"user_vars":{"x-hasura-role":"admin"}},"request_id":"f13fc013-9718-4b4e-b6d1-1ff546a57bdf"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:48.845087313Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":3.450779e-3,"request_id":"92c28e3e-c278-4af3-9f41-927be45507b8","request_mode":"non-graphql","request_read_time":1.836e-6,"response_size":60,"user_vars":{"x-hasura-role":"admin"}},"request_id":"92c28e3e-c278-4af3-9f41-927be45507b8"},"level":"info","timestamp":"2022-10-03T15:37:48.776+0000","type":"http-log"}
2022-10-03T15:37:48.845090551Z {"detail":{"http_info":{"content_encoding":"gzip","http_version":"HTTP/1.1","ip":"127.0.0.1","method":"POST","status":200,"url":"/v1/metadata"},"operation":{"query_execution_time":1.1286706e-2,"request_id":"367464c4-db6b-4084-9a89-1b3f75028d7f","request_mode":"non-graphql","request_read_time":2.074e-6,"response_size":184,"user_vars":{"x-hasura-role":"admin"}},"request_id":"367464c4-db6b-4084-9a89-1b3f75028d7f"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:48.845100738Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"127.0.0.1","method":"GET","status":200,"url":"/v1/version"},"operation":{"request_id":"07822304-6817-47d0-a8f1-9ee836918fdd","request_mode":"non-graphql","response_size":16},"request_id":"07822304-6817-47d0-a8f1-9ee836918fdd"},"level":"info","timestamp":"2022-10-03T15:37:47.614+0000","type":"http-log"}
2022-10-03T15:37:49.228089355Z {"timestamp":"2022-10-03T15:37:49.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-shutdown","info":"killing temporary server"}}
2022-10-03T15:37:49.229222891Z {"timestamp":"2022-10-03T15:37:49.000+0000","level":"info","type":"startup","detail":{"kind":"migrations-shutdown","info":"graphql-engine will now start in normal mode"}}
2022-10-03T15:37:49.674617614Z {"detail":{"info":{"admin_secret_set":true,"auth_hook":null,"auth_hook_mode":null,"console_assets_dir":null,"cors_config":{"allowed_origins":"*","disabled":false,"ws_read_cookie":null},"enable_allowlist":false,"enable_console":true,"enable_maintenance_mode":false,"enable_metadata_query_logging":false,"enable_telemetry":true,"enabled_apis":["config","pgdump","metadata","graphql"],"enabled_log_types":["startup","webhook-log","http-log","websocket-log"],"events_fetch_batch_size":100,"experimental_features":[],"graceful_shutdown_timeout":60,"infer_function_permissions":true,"jwt_secret":[],"live_query_options":{"batch_size":100,"refetch_delay":1},"log_level":"info","port":8080,"remote_schema_permissions":false,"server_host":"HostAny","stringify_numeric_types":false,"transaction_isolation":"ISOLATION LEVEL READ COMMITTED","unauth_role":null,"use_prepared_statements":true,"v1-boolean-null-collapse":false,"websocket_compression_options":"NoCompression","websocket_connection_init_timeout":"Seconds {seconds = 3s}","websocket_keep_alive":"KeepAliveDelay {unKeepAliveDelay = Seconds {seconds = 5s}}"},"kind":"server_configuration"},"level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"startup"}
2022-10-03T15:37:49.849607009Z {"detail":{"info":"gracefully shutting down server","kind":"server"},"level":"info","timestamp":"2022-10-03T15:37:48.776+0000","type":"startup"}
2022-10-03T15:37:49.849635831Z {"detail":"Stopping immortal runTelemetry thread","level":"info","timestamp":"2022-10-03T15:37:48.776+0000","type":"unstructured"}
2022-10-03T15:37:49.849649211Z {"detail":"Stopping immortal checkForUpdates thread","level":"info","timestamp":"2022-10-03T15:37:48.776+0000","type":"unstructured"}
2022-10-03T15:37:49.849652827Z {"detail":{"info":"All in-flight events have finished processing","kind":"scheduled_events"},"level":"info","timestamp":"2022-10-03T15:37:48.776+0000","type":"startup"}
2022-10-03T15:37:50.676812630Z {"detail":{"info":{"database_url":"postgres://postgres:...@postgres-service:5432/r2pos","retries":3},"kind":"postgres_connection"},"level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"startup"}
2022-10-03T15:37:50.676873504Z {"detail":{"info":"Already at the latest catalog version (47); nothing to do.","kind":"catalog_migrate"},"level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"startup"}
2022-10-03T15:37:50.676882366Z {"detail":{"info":"Schema sync enabled. Polling at Milliseconds {milliseconds = 1s}","kind":"schema-sync"},"level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"startup"}
2022-10-03T15:37:50.676887813Z {"detail":{"info":{"instance_id":"dad04624-69e3-4ba7-9421-398e1e99774d","message":"listener thread started","thread_id":"ThreadId 44"},"kind":"schema-sync"},"level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"startup"}
2022-10-03T15:37:50.676895541Z {"detail":"The following environment variables are deprecated and moved to metadata: HASURA_GRAPHQL_NO_OF_RETRIES","level":"warn","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:50.676900444Z {"detail":{"info":{"instance_id":"dad04624-69e3-4ba7-9421-398e1e99774d","message":"processor thread started","thread_id":"ThreadId 59"},"kind":"schema-sync"},"level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"startup"}
2022-10-03T15:37:50.676907065Z {"detail":{"info":"starting workers","kind":"event_triggers"},"level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"startup"}
2022-10-03T15:37:50.676912084Z {"detail":{"info":"preparing data","kind":"scheduled_triggers"},"level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"startup"}
2022-10-03T15:37:50.676949440Z {"detail":{"info":"Help us improve Hasura! The graphql-engine server collects anonymized usage stats which allows us to keep improving Hasura at warp speed. To read more or opt-out, visit https://hasura.io/docs/latest/graphql/core/guides/telemetry.html","kind":"telemetry"},"level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"startup"}
2022-10-03T15:37:50.676958356Z {"detail":{"info":{"message":"starting API server","time_taken":0.616457875},"kind":"server"},"level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"startup"}
2022-10-03T15:37:50.676963222Z {"detail":"Thread SchemeUpdate.listener (re)started","level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:50.676969123Z {"detail":"Thread ourIdleGC (re)started","level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:50.676972712Z {"detail":"Thread SchemeUpdate.processor (re)started","level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:50.676976026Z {"detail":"Thread asyncActionsProcessor (re)started","level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:50.676979162Z {"detail":"Thread processScheduledTriggers (re)started","level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:50.676982066Z {"detail":"Thread runTelemetry (re)started","level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:50.676985054Z {"detail":"Thread processEventQueue (re)started","level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:50.676988324Z {"detail":"Thread asyncActionSubscriptionsProcessor (re)started","level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:50.676991385Z {"detail":"Thread runCronEventsGenerator (re)started","level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:50.676994248Z {"detail":"Thread checkForUpdates (re)started","level":"info","timestamp":"2022-10-03T15:37:49.674+0000","type":"unstructured"}
2022-10-03T15:37:55.379119150Z {"detail":"Stopping immortal processScheduledTriggers thread","level":"info","timestamp":"2022-10-03T15:37:55.378+0000","type":"unstructured"}
2022-10-03T15:37:56.367365785Z {"detail":"Stopping immortal runCronEventsGenerator thread","level":"info","timestamp":"2022-10-03T15:37:55.378+0000","type":"unstructured"}
2022-10-03T15:37:56.367429126Z {"detail":"Stopping immortal asyncActionSubscriptionsProcessor thread","level":"info","timestamp":"2022-10-03T15:37:55.378+0000","type":"unstructured"}
2022-10-03T15:37:56.367435609Z {"detail":{"info":"All in-flight events have finished processing","kind":"async_actions"},"level":"info","timestamp":"2022-10-03T15:37:55.378+0000","type":"startup"}
2022-10-03T15:37:56.367442300Z {"detail":"Stopping immortal asyncActionsProcessor thread","level":"info","timestamp":"2022-10-03T15:37:55.378+0000","type":"unstructured"}
2022-10-03T15:37:56.367445764Z {"detail":{"info":"All in-flight events have finished processing","kind":"event_triggers"},"level":"info","timestamp":"2022-10-03T15:37:55.378+0000","type":"startup"}
2022-10-03T15:37:56.367449390Z {"detail":"Stopping immortal processEventQueue thread","level":"info","timestamp":"2022-10-03T15:37:55.378+0000","type":"unstructured"}
2022-10-03T15:37:56.367454095Z {"detail":"Stopping immortal SchemeUpdate.processor thread","level":"info","timestamp":"2022-10-03T15:37:55.378+0000","type":"unstructured"}
2022-10-03T15:37:56.367457350Z {"detail":"Stopping immortal SchemeUpdate.listener thread","level":"info","timestamp":"2022-10-03T15:37:55.378+0000","type":"unstructured"}
2022-10-03T15:44:01.531131479Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"10.116.0.4","method":"POST","status":404,"url":"/"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"91bc8d97-5928-4284-a1ef-4da37309ad11","request_mode":"error","response_size":65},"request_id":"91bc8d97-5928-4284-a1ef-4da37309ad11"},"level":"error","timestamp":"2022-10-03T15:44:01.530+0000","type":"http-log"}
2022-10-03T15:44:02.531473700Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"10.116.0.4","method":"GET","status":404,"url":"/.env"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"058d1a67-db1c-4af4-aeb1-664f08604262","request_mode":"error","response_size":65},"request_id":"058d1a67-db1c-4af4-aeb1-664f08604262"},"level":"error","timestamp":"2022-10-03T15:44:01.530+0000","type":"http-log"}
2022-10-03T15:51:28.475964121Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"10.116.0.4","method":"GET","status":404,"url":"/.env"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"0c2910fc-af09-4f2e-b61b-6609ea06773c","request_mode":"error","response_size":65},"request_id":"0c2910fc-af09-4f2e-b61b-6609ea06773c"},"level":"error","timestamp":"2022-10-03T15:51:28.475+0000","type":"http-log"}
2022-10-03T15:51:29.477257344Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"10.116.0.4","method":"POST","status":404,"url":"/"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"5236be91-db51-4a41-9333-a85c751e3fb9","request_mode":"error","response_size":65},"request_id":"5236be91-db51-4a41-9333-a85c751e3fb9"},"level":"error","timestamp":"2022-10-03T15:51:28.475+0000","type":"http-log"}
2022-10-03T16:03:25.266164827Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"10.116.0.4","method":"GET","status":404,"url":"/.env"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"83b2f4e1-c8f8-465e-83b9-888a7f35648b","request_mode":"error","response_size":65},"request_id":"83b2f4e1-c8f8-465e-83b9-888a7f35648b"},"level":"error","timestamp":"2022-10-03T16:03:25.265+0000","type":"http-log"}
2022-10-03T16:03:26.267346117Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"167.172.153.196","method":"POST","status":404,"url":"/"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"a0ee8414-a713-44c4-97d2-8ba87d5626bd","request_mode":"error","response_size":65},"request_id":"a0ee8414-a713-44c4-97d2-8ba87d5626bd"},"level":"error","timestamp":"2022-10-03T16:03:25.265+0000","type":"http-log"}
2022-10-03T16:21:54.056732151Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"167.172.153.196","method":"GET","status":404,"url":"/manager/text/list"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"54964afe-093a-470e-9646-cb45e40a16bf","request_mode":"error","response_size":65},"request_id":"54964afe-093a-470e-9646-cb45e40a16bf"},"level":"error","timestamp":"2022-10-03T16:21:54.056+0000","type":"http-log"}
2022-10-03T16:31:04.253276761Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"167.172.153.196","method":"POST","status":404,"url":"/HNAP1/"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"c3c834fe-9b11-446e-9d07-b0e86f89c0d9","request_mode":"error","response_size":65},"request_id":"c3c834fe-9b11-446e-9d07-b0e86f89c0d9"},"level":"error","timestamp":"2022-10-03T16:31:04.252+0000","type":"http-log"}
2022-10-03T16:45:23.614572625Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"10.116.0.3","method":"POST","status":404,"url":"/"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"df02ab41-5194-4e23-a1e0-bceb995a28c3","request_mode":"error","response_size":65},"request_id":"df02ab41-5194-4e23-a1e0-bceb995a28c3"},"level":"error","timestamp":"2022-10-03T16:45:23.614+0000","type":"http-log"}
2022-10-03T16:45:24.614984338Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"10.116.0.4","method":"GET","status":404,"url":"/.env"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"72b3b54d-e9b0-4d1e-9e9d-c94c26ee4fce","request_mode":"error","response_size":65},"request_id":"72b3b54d-e9b0-4d1e-9e9d-c94c26ee4fce"},"level":"error","timestamp":"2022-10-03T16:45:23.614+0000","type":"http-log"}
2022-10-03T16:51:53.599976248Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"167.172.153.196","method":"GET","status":404,"url":"/.git/config"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"ab8e2e93-b66e-4516-b548-36e16b325b5b","request_mode":"error","response_size":65},"request_id":"ab8e2e93-b66e-4516-b548-36e16b325b5b"},"level":"error","timestamp":"2022-10-03T16:51:53.599+0000","type":"http-log"}
2022-10-03T16:53:07.755053091Z {"detail":{"http_info":{"content_encoding":null,"http_version":"HTTP/1.1","ip":"10.116.0.4","method":"GET","status":404,"url":"/.git/config"},"operation":{"error":{"code":"not-found","error":"resource does not exist","path":"$"},"request_id":"7f37244d-55b3-4229-8348-1511646aef92","request_mode":"error","response_size":65},"request_id":"7f37244d-55b3-4229-8348-1511646aef92"},"level":"error","timestamp":"2022-10-03T16:53:07.754+0000","type":"http-log"}
2022-10-03T17:09:39.924823726Z {"detail":{"info":{"error":{"info":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_metadata\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n SELECT resource_version from hdb_catalog.hdb_metadata\n "},"path":"$"},"type":"query_error"}},"thread_type":"listener"},"level":"error","timestamp":"2022-10-03T17:09:39.924+0000","type":"schema-sync-thread"}
2022-10-03T17:09:39.924863904Z {"detail":{"info":{"metadataResourceVersion":0},"thread_type":"listener"},"level":"info","timestamp":"2022-10-03T17:09:39.924+0000","type":"schema-sync-thread"}
2022-10-03T17:09:43.969812741Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:09:43.969+0000","type":"scheduled-trigger"}
2022-10-03T17:09:53.980883186Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:09:53.980+0000","type":"scheduled-trigger"}
2022-10-03T17:10:04.004882744Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:10:04.004+0000","type":"scheduled-trigger"}
2022-10-03T17:10:14.027673050Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:10:14.027+0000","type":"scheduled-trigger"}
2022-10-03T17:10:24.054759358Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:10:24.054+0000","type":"scheduled-trigger"}
2022-10-03T17:10:34.078322570Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:10:34.078+0000","type":"scheduled-trigger"}
2022-10-03T17:10:44.104349998Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:10:44.104+0000","type":"scheduled-trigger"}
2022-10-03T17:10:54.127916121Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:10:54.127+0000","type":"scheduled-trigger"}
2022-10-03T17:11:04.150655407Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:11:04.150+0000","type":"scheduled-trigger"}
2022-10-03T17:11:14.174642665Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:11:14.174+0000","type":"scheduled-trigger"}
2022-10-03T17:11:24.199642995Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:11:24.199+0000","type":"scheduled-trigger"}
2022-10-03T17:11:34.222391329Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:11:34.222+0000","type":"scheduled-trigger"}
2022-10-03T17:11:44.246423384Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:11:44.246+0000","type":"scheduled-trigger"}
2022-10-03T17:11:54.271724271Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:11:54.271+0000","type":"scheduled-trigger"}
2022-10-03T17:12:04.297551518Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:12:04.297+0000","type":"scheduled-trigger"}
2022-10-03T17:12:14.319481873Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:12:14.319+0000","type":"scheduled-trigger"}
2022-10-03T17:12:24.344449825Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:12:24.344+0000","type":"scheduled-trigger"}
2022-10-03T17:12:34.373341821Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:12:34.373+0000","type":"scheduled-trigger"}
2022-10-03T17:12:44.397078451Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:12:44.396+0000","type":"scheduled-trigger"}
2022-10-03T17:12:54.420792184Z {"detail":{"code":"unexpected","error":"database query error","internal":{"arguments":[],"error":{"description":null,"exec_status":"FatalError","hint":null,"message":"relation \"hdb_catalog.hdb_cron_events\" does not exist","status_code":"42P01"},"prepared":true,"statement":"\n WITH cte AS\n ( UPDATE hdb_catalog.hdb_cron_events\n SET status = 'locked'\n WHERE id IN ( SELECT t.id\n FROM hdb_catalog.hdb_cron_events t\n WHERE ( t.status = 'scheduled'\n and (\n (t.next_retry_at is NULL and t.scheduled_time <= now()) or\n (t.next_retry_at is not NULL and t.next_retry_at <= now())\n )\n )\n FOR UPDATE SKIP LOCKED\n )\n RETURNING *\n )\n SELECT row_to_json(t.*) FROM cte AS t\n "},"path":"$"},"level":"error","timestamp":"2022-10-03T17:12:54.420+0000","type":"scheduled-trigger"}
```

### Any possible solutions?

### Can you identify the location in the source code where the problem exists?

### If the bug is confirmed, would you be willing to submit a PR?

### Keywords

Start by reviewing the Kubernetes deployment, the migrations image configuration, and the startup logs showing catalog version 47 and the default migration and metadata directories. Verify why hdb_catalog.hdb_cron_events and hdb_catalog.hdb_metadata are unavailable after startup, then confirm the deployment remains functional over time without the scheduled-trigger and schema-sync errors.

Written by the indexing model from the issue text.