aws-samples / aws-samples/serverless-data-analytics

Lab 3 - Glue job in 2 min (instead of 30 minutes)

Open
#7 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
176
Forks
97
PR merge metrics
No merged PRs in 30d

Description

Just wanted to comment that the job ran in 2 minutes, instead of 30 minutes as mentioned in the instructions. Could be due to Spark 2.4 + Python 3.

Contributor guide

Open the contributing guide

Research direction

Review the Lab 3 instructions and compare the reported 2-minute runtime with the stated 30 minutes under Spark 2.4 and Python 3. Verify whether the version combination explains the difference, then update the instructions so the expected runtime is accurate or the relevant environment is clearly stated.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python, spark
Domain
cloud, data-engineering, documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.