aws / aws/sagemaker-spark

Newer versions of the library on maven central

Open
#96 5 comments 0 reactions 0 assignees View on GitHub
feature request
Dominant language
Scala
Stars
301
Forks
129
PR merge metrics
No merged PRs in 30d

Description

### System Information

- spark_2.2.0-1.2.5
- Spark 2.3 and later

### Describe the problem
EMR clusters which use spark 2.3 and later have newer versions of sagemaker spark jars.

However they are not available on maven central : https://mvnrepository.com/artifact/com.amazonaws/sagemaker-spark

When is the plan to release to maven central for spark 2.3 and later? Or any recommendations for running on later EMR versions of the cluster.

### Minimal repo / logs

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the sagemaker-spark release and publishing setup, then compare the versions available on Maven Central with the Spark 2.3-and-later and EMR versions described in the issue. The issue names no source files or tests; done would mean confirming a supported release path or documenting recommendations for later EMR clusters.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala, spark
Domain
data-engineering, release
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.