apache / apache/beam

[Task][prism]: Be able to execute non-Go SDKs on Prism.

Closed
#28,187 2 comments 0 reactions 1 assignee Claimed by @lostluck View on GitHub
go P2 prism stale task
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Backlink to global prism tracking issue: #29650

### What needs to happen?

Umbrella task for tracking PRs to improve prism and get it to support non-go SDKs.

More targeted tasks should be filed for other work items, and linked here.

This includes

- [x] Improving error output for Prism to make SDK or prism side failures clearer.
- With rare exceptions, prism no longer crashes on certain failures, allowing errors to return to the calling runners. Other issues are around specific failure clarity that will be handled on a case by case basis.
- [x] Improve general debugging capabilities for Prism.
- [x] Execution time panics converted to errors to simplify user test output.
- [x] Stage descriptor building time panics converted to errors to simplify user test output.
- [x] Gracefully shutting down worker GRPC server to reduce spurious noise from SDKs.
- [x] Docker environment support. [DONE #28444]
- [x] Cross language / multiple environment support [DONE #28545].
- [x] #29697
- [x] #31402
- [x] #31793
- [x] Run Java Validates Runner tests on Prism
- Validates Runner Test Control file https://github.com/apache/beam/blob/master/runners/portability/java/build.gradle
- [ ] Java Runner Wrapper to execute a job against Prism (via Go being available) for dev versions
- [x] #31403
- [x] #32637
- [x] #32877

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.