apache / apache/beam

How to run typescript apache beam pipeline in Flink Cluster

Open
#27,581 2 comments 0 reactions 0 assignees View on GitHub
stale
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Hi Team,

I have tried starting apache flink in localhost and run typescript apache beam pipeline. I could not make succeed on this. is there any step by step document to achieve the same.

Used below docker compose to start cluster in localhost.

```
version: "3.8"
services:
jobmanager:
image: flink:latest
hostname: jobmanager
ports:
- "8081:8081"
command: jobmanager
environment:
FLINK_PROPERTIES: "jobmanager.rpc.address: jobmanager"
volumes:
- .:/home
taskmanager:
image: flink:latest
hostname: taskmanager
depends_on:
- jobmanager
command: taskmanager
scale: 2
volumes:
- .:/home
environment:
- |
FLINK_PROPERTIES=
jobmanager.rpc.address: jobmanager
taskmanager.numberOfTaskSlots: 4
```

Tried below command to run pipeline against flink cluster.

```
node dist/src/main.js --input_text="Greetings" \
--runner=flink --flinkMaster="http://0.0.0.0:8081"
```

Any help would be appreciated!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.