aws-cloudformation / aws-cloudformation/cloudformation-coverage-roadmap

[AWS::Glue::Crawler] - [Enhancement] - https://github.com/aws/aws-cdk/issues/31133

Open
#2,120 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
No language data
Stars
1.1k
Forks
62
PR merge metrics
No merged PRs in 30d

Description

### Name of the resource

AWS::Glue::Crawler

### Resource name

_No response_

### Description

Posting : https://github.com/aws/aws-cdk/issues/31133

---

### Describe the feature

Hello
If I set up my crawler from GUI console I can choose Hudi S3 Table as a data source to be crawled. This is not yet possible neither on CFN or CDK. CDK already has iceberg and delta lake as sources for the crawler but no Hudi : https://docs.aws.amazon.com/cdk/api/v2/docs/aws-cdk-lib.aws_glue.CfnCrawler.html

### Use Case

I would like to use the serde Hudi and not parquet when crawling my hudi S3 folders, although available via GUI it is still not present in CDK or CFN

### Proposed Solution

P1. Add at least to CloudFormation HudiTarget to complete the data lake frameworks formats (given that Iceberg and Delta Target are present in CFN)

P2. Add to CDK the target type

### Other Information

_No response_

### Acknowledgements

- [X] I may be able to implement this feature request
- [ ] This feature might incur a breaking change

### CDK version used

"aws-cdk-lib": "^2.115.0",

### Environment details (OS name and version, etc.)

MACBookPro M1

### Other Details

_No response_

Contributor guide

Open the contributing guide

Research direction

Start with the AWS::Glue::Crawler resource named in the issue and review the linked aws-cdk issue 31133. Compare the existing Iceberg and Delta target coverage with the requested Hudi S3 Table source. Done means the requested HudiTarget support is clearly covered in CloudFormation and CDK, with the roadmap status updated.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
cloud, infrastructure
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.