aws / aws/aws-cdk

glue: Glue Tables / Glue Schemas (with regular expressions as 'patterns') are not properly linked

Open
#27,758 3 comments 0 reactions 0 assignees View on GitHub
@aws-cdk/aws-glue bug effort/medium p2
Dominant language
TypeScript
Stars
12.9k
Forks
4.6k
Avg merge
1d 19h
Merged PRs (30d)
71

Description

### Describe the bug

The created glue tables are not properly linked with the given glue schema. In the test-case, the glue schema contains patterns, which represent the allowed strings.

Schema used in AWS schema registry (with regular expressions/patterns):

![image](https://github.com/aws/aws-cdk/assets/26426283/80f7d1d7-eada-4ffe-9bf7-b92fdacda88b)

### Expected Behavior

The glue schema is properly associated (linked or refered) to the glue table being created.

### Current Behavior

This is the glue table created with CDK:

![image](https://github.com/aws/aws-cdk/assets/26426283/350d0c95-db5d-4fca-ab3b-e6c1059d1dfb)

clicking on "Edit Schema", the schema can be edited as simple schema (the regular expressions are removed):

![image](https://github.com/aws/aws-cdk/assets/26426283/be034900-5d85-4dc6-b42b-df0ef250573e)

**EXPECTED:** the schema can be changed (using a list box) with existing versions in aws glue schema.

For checking this functionality, I created a schema and a table (manually).

![image](https://github.com/aws/aws-cdk/assets/26426283/e4eecf17-5cd0-4740-a7f0-82513479427e)

The behaviour of "edit schema" is this new dialog:

![image](https://github.com/aws/aws-cdk/assets/26426283/df1603b7-67a4-4bed-9042-a79b9de0ad82)

### Reproduction Steps

see screenshots in Current Behaviour / Bug description

### Possible Solution

_No response_

### Additional Information/Context

_No response_

### CDK CLI Version

2.103.1 (build 3bb19ac)

### Framework Version

_No response_

### Node.js Version

9.5.1

### OS

Windows

### Language

Java

### Language Version

_No response_

### Other information

_No response_

Contributor guide

Open the contributing guide

Research direction

The issue identifies AWS Glue tables and schemas but names no source files, tests, or entry points. Start by locating the CDK Glue table and schema implementation and compare its generated association with the manually created table; done means existing Glue schema versions and pattern definitions remain linked and selectable.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, typescript
Domain
cloud, data
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.