aws / aws/aws-cdk

aws-msk-alpha: support multi-VPC private connectivity

Open
#28,640 3 comments 8 reactions 0 assignees View on GitHub
@aws-cdk/aws-msk effort/medium feature-request p2
Dominant language
TypeScript
Stars
12.9k
Forks
4.6k
Avg merge
2d 3h
Merged PRs (30d)
83

Description

### Describe the feature

As per the announcement: https://aws.amazon.com/about-aws/whats-new/2023/04/amazon-msk-multi-vpc-private-connectivity-cross-account-access/

Amazon Managed Streaming for Apache Kafka (MSK) now offers multi-VPC private connectivity that simplifies connectivity and access to your Amazon MSK clusters from your Apache Kafka clients hosted in any VPC or AWS account.

### Use Case

Customers currently need to manually turn on the Multi-VPC option within the console. Some customers have requirements around doing all actions via Infrastructure as Code.

### Proposed Solution

_No response_

### Other Information

Currently there are some limitations to keep in mind: https://docs.aws.amazon.com/msk/latest/developerguide/aws-access-mult-vpc.html#mvpc-requirements
- Multi-VPC only on Apache Kafka 2.7.1 or higher.
- Unauthenticated clusters can't use multi-VPC private connectivity.
- Doesn’t support the t3.small instance type.
- Isn’t supported across AWS Regions, only on AWS accounts within the same Region.
- Amazon MSK doesn't support multi-VPC private connectivity to Zookeeper nodes.

### Acknowledgements

- [ ] I may be able to implement this feature request
- [ ] This feature might incur a breaking change

### CDK version used

2.118.0

### Environment details (OS name and version, etc.)

N/A

Contributor guide

Open the contributing guide

Research direction

Start in the aws-msk-alpha module, then read the linked Amazon MSK multi-VPC announcement and the documented limitations. Determine the existing MSK configuration entry point and how the multi-VPC option should be represented for infrastructure as code; done means customers can enable it without using the console while the documented constraints remain respected.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, kafka, typescript
Domain
cloud, infrastructure
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.