apache / apache/airflow

Add dedicated execution API route for retrieving the large literal payload when TI start

Open
#72,612 0 comments 0 reactions 1 assignee Claimed by @jason810496 View on GitHub
kind:meta
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 9h
Merged PRs (30d)
472

Description

### Body

- related: https://github.com/apache/airflow/pull/71871
- This is unnecessary in the first place since _most_ of the literal payload passing across language should be small enough and shouldn't be a large startup overhead.
- Create as a issue to keep track of this optional follow-up, it's only necessary until user complain.
- We can make it somehow _stream_ the value properly from serialized Dag payload to the Lang SDK runtime.

### Committer

- [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.