aws-samples / aws-samples/emr-serverless-samples

configuration_overrides shouldn't be required

Open
#25 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
172
Forks
84
PR merge metrics
No merged PRs in 30d

Description

`configuration_overrides` is a required field in `EmrServerlessStartJobOperator`, but [it's not a required field](https://docs.aws.amazon.com/emr-serverless/latest/APIReference/API_StartJobRun.html#API_StartJobRun_RequestBody).

Error message when trying to start a job without it:

```
E airflow.exceptions.AirflowException: Argument ['configuration_overrides'] is required
```

Contributor guide

Open the contributing guide

Research direction

Start at the EmrServerlessStartJobOperator implementation and trace the validation that marks configuration_overrides as required. Compare it with the EMR Serverless StartJobRun request documentation, then verify that starting a job without configuration_overrides no longer raises the reported exception.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cloud
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.