azavea / azavea/osmesa

Exclude AWS SDK JARs when creating an assembly

Open
#159 1 comment 0 reactions 1 assignee Claimed by @sethfitz View on GitHub
Dominant language
Scala
Stars
81
Forks
26
PR merge metrics
No merged PRs in 30d

Description

This shrinks the size of the assembly while also improving compatibility with EMR. When there are conflicts, Glue Catalog can't be used. When the AWS JARs are excluded, it works just fine (with provided versions of these libraries).

```sbt
assemblyExcludedJars in assembly := {
val cp = (fullClasspath in assembly).value
cp filter { f =>
f.data.getName.contains("aws-java-sdk")
}
}
```

`geotrellis-s3` (as `gtS3`) includes an `exclude()` in its dependencies; that may be able to go away using this approach.

(This should be applied to each of the projects here and probably ported to VP as well.)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.