apache / apache/polaris

Unable to use AWS S3 locations with quotes in path

Open
#1,545 5 comments 0 reactions 1 assignee Claimed by @adnanhemani View on GitHub
bug
Dominant language
Java
Stars
2.1k
Forks
522
Avg merge
1d 22h
Merged PRs (30d)
137

Description

### Describe the bug

Polaris fails to accept S3 locations that are valid in AWS, but contain `"` in the path.

For example: `s3://example/pol"3/`

### To Reproduce

1. Start Polaris
2. Try to create catalog:
```
$ ./polaris --client-id *** --client-secret *** catalogs create polaris2 \
--storage-type S3 \
--default-base-location 's3://example-bucket-42/pol"2/' \
--role-arn arn:aws:iam::11111111111:role/test --external-id ***
```

### Actual Behavior

```
Exception when communicating with the Polaris server. IllegalArgumentException: Illegal character in path at index 26: s3://example-bucket-42/pol"2/
```

### Expected Behavior

No exception

### Additional context

The example location is considered valid in AWS UI. It is possible to create it and copy its S3 location in AWS UI.

### System information

Local Polaris Server build as of commit 04c4f9112e450133e1eab2831dcc63f5885e8795

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.