aws-samples / aws-samples/aws-glue-samples

Wrong escape character in avro.schema.url

Open
#150 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.5k
Forks
834
Avg merge
2d 17h
Merged PRs (30d)
1

Description

When doing the export from hive to S3 it creates the following:
```
WITH SERDEPROPERTIES (
'avro.schema.url'='s3\\://bucket/directory/_schema.avsc')
```
and this cannot be parsed correctly
Is it possible to fix to avoid that? Because when I replace with:
```
WITH SERDEPROPERTIES (
'avro.schema.url'='s3://bucket/directory/_schema.avsc')
```
it works as expected

Contributor guide

Open the contributing guide

Research direction

No file or test is identified. Start by locating the Hive-to-S3 export entry point that emits the avro.schema.url SERDEPROPERTY, then reproduce the generated SQL and compare the escaped and unescaped URLs. Done means the export produces a parsable s3:// URL without the extra escape character.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cloud, data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.