aws / aws/sagemaker-python-sdk
Document which JARs are available for PySparkProcessor by default
Open
component: processing
type: documentation
- Dominant language
- Python
- Stars
- 2.3k
- Forks
- 1.3k
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 32
Description
**What did you find confusing? Please describe.**
In AWS EMR, it's explicitly stated in documentation what .jar files are built in. For example, optimized connector to Amazon Redshift is built in. Relation between EMR and SageMaker implementations of PySpark are not mentioned anywhere, especially about connectors and Redshift.
**Describe how documentation can be improved**
Note explicitly which .jar additional files and connectors are built in for SageMaker PySpark implementations.
**Additional context**
Redshift is a popular data source for ML, and it would be very convenient if:
- connector from EMR was built in
- this was stated explicitly in documentation
Contributor guide
Assessment
This issue has not been assessed yet.