ckan / ckan/ideas

Streaming/chunked API (and others) response

Open
#128 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
39
Forks
1
PR merge metrics
No merged PRs in 30d

Description

see ckan/ckan#1847, currently the response string is fully constructed before sending it, we could do something along the lines of using an iterator to send responses so we don't end up eating large chunks of memory when sending large api responses and perhaps sending these as chunked responses?

Contributor guide

No contributing guide indexed for this repository

Research direction

Review ckan/ckan#1847 first, then trace how large API responses are currently constructed and sent. Define completion as sending responses incrementally without retaining the full response in memory, including the proposed chunked behavior, and verify this across the affected APIs.

Written by the indexing model from the issue text.

Assessment

Domain
api, backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.