cube-js / cube-js/cube

envoy sidecar TLS proxy and cubestore-router to cubestore-worker traffic

Open
#7,022 0 comments 0 reactions 0 assignees View on GitHub
question
Dominant language
Rust
Stars
20.8k
Forks
2.1k
Avg merge
1d 2h
Merged PRs (30d)
181

Description

I am deploying cubejs/cubestore into a kubernetes cluster. My deployment is similar [to this example](https://github.com/cube-js/cube/blob/master/examples/kubernetes/cluster/cubestore-workers-service.yaml) (I do not use a stateful set for the cubestore-worker or a headless service - just a deployment and a regular service).

So far I have used envoy sidecar proxies to
1. encrypt other non-cube pod traffic to the cube-api.
2. encrypt traffic from cubestore-worker to exterior pods like ksqldb.
3. encrypt traffic from cube-api/cube-refresh-worker to cubestore-router.

However, using the same techniques does not work from traffic from cubestore-router pod to cubestore-worker pod. Instead the router logs show the following error multiple times:

`ERROR [cubestore::scheduler] Error processing event Insert(Tables, 6): Corrupted message received. Please check your worker and meta connection environment variables.`

The cubestore-worker sidecar logs show the following error:

`[debug][http] [source/common/http/conn_manager_impl.cc:403] [Tags: "ConnectionId":"6"] dispatch error: http/1.1 protocol error: HPE_INVALID_METHOD`

All this suggests that there is some unique customized behaviour in the way the cubestore-router communicates with cubestore-worker. Can anyone help me better understand this behaviour?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.