aws-samples / aws-samples/aws-glue-samples
Wrong escape character in avro.schema.url
- Dominant language
- Python
- Stars
- 1.5k
- Forks
- 834
- Avg merge
- 2d 17h
- Merged PRs (30d)
- 1
Description
When doing the export from hive to S3 it creates the following:
```
WITH SERDEPROPERTIES (
'avro.schema.url'='s3\\://bucket/directory/_schema.avsc')
```
and this cannot be parsed correctly
Is it possible to fix to avoid that? Because when I replace with:
```
WITH SERDEPROPERTIES (
'avro.schema.url'='s3://bucket/directory/_schema.avsc')
```
it works as expected
Contributor guide
Research direction
No file or test is identified. Start by locating the Hive-to-S3 export entry point that emits the avro.schema.url SERDEPROPERTY, then reproduce the generated SQL and compare the escaped and unescaped URLs. Done means the export produces a parsable s3:// URL without the extra escape character.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, python
- Domain
- cloud, data-engineering
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100