kedro-org / kedro-org/kedro-plugins

[kedro-airflow] Update `kedro-airflow` to take in custom session id

Open
#48 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
119
Forks
136
Avg merge
4d 10h
Merged PRs (30d)
5

Description

## Description
To be done after https://github.com/kedro-org/kedro/issues/1731

## Context
https://github.com/kedro-org/kedro/issues/1551

It was decided to allow users to customise the `session_id` which would make it easier when using an orchestrator like Airflow to map airflow runs to kedro runs and versioned datasets.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing Kedro issues #1731 and #1551, then inspect the kedro-airflow plugin's handling of session_id. Determine where a custom session ID can be accepted so Airflow runs map to Kedro runs and versioned datasets; done means the requested customization is supported and verified by the relevant plugin tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
devops
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.