awslabs / awslabs/amazon-kinesis-client-nodejs

Graceful Shutdown of Workers

Open
#34 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
304
Forks
198
Avg merge
36m
Merged PRs (30d)
2

Description

Since September 30, 2016, there's a new method in KCL's library (for Java) that handles very well the shutdown. Its called "requestShutdown", and it has already been implemented there.

https://github.com/awslabs/amazon-kinesis-client/pull/109

We are missing that method here in Node... when KCL decides to shutdown a worker, how can we handle and perform a Graceful Shutdown? Meaning that would be cool to let the worker to finish processing the current batch, then checkpoint, and only then start the shutdown.

Contributor guide

Open the contributing guide

Research direction

Start by comparing the Java KCL requestShutdown implementation in PR #109 with the Node worker lifecycle. Trace how shutdown is handled in the Node worker, then verify that the current batch finishes, a checkpoint is written, and shutdown begins only afterward.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, javascript, node.js
Domain
backend, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.