AbsaOSS / AbsaOSS/atum

Info.convertFullPathToFsAndRelativePath fails on ` (backtick) in s3 path

Open
#155 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
30
Forks
9
PR merge metrics
No merged PRs in 30d

Description

### Repro steps:

``` scala
val path = "s3a://bucket/data/`backticked.name`"
val (fs, p) = InfoFile.convertFullPathToFsAndRelativePath(path)(hadoopConfig)
```

### Error:
``` stacktrace
Illegal character in path at index 18: s3a://bucket/data/`backticked.name`
java.net.URISyntaxException: Illegal character in path at index 18: s3a://bucket/data/`backticked.name`
at java.net.URI$Parser.fail(URI.java:2873)
at java.net.URI$Parser.checkChars(URI.java:3046)
at java.net.URI$Parser.parseHierarchical(URI.java:3130)
at java.net.URI$Parser.parse(URI.java:3078)
at java.net.URI.(URI.java:588)
at za.co.absa.atum.utils.InfoFile$.convertFullPathToFsAndRelativePath(InfoFile.scala:45)
```

### Expected result:
The method shouldn't fail. Backtick is a valid path char in this context.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.