CentreForDigitalHumanities / CentreForDigitalHumanities/Textcavator

Stream large CSV files

Open
#1,286 1 comment 0 reactions 0 assignees View on GitHub
backend
Dominant language
Python
Stars
12
Forks
3
Avg merge
3d 3m
Merged PRs (30d)
9

Description

I was reading the [django documentation on CSV output in views](https://docs.djangoproject.com/en/4.2/howto/outputting-csv/).

We don't have to follow Django's suggestions, of course, but I was wondering about their advice to use a `StreamingHttpResponse` for large files. If permitted, users might download very large CSV files from I-analyzer, but I'm not sure if this can cause issues at the moment. If so, this could be worth looking into.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no project file or test. Start with the linked Django CSV-output documentation and trace the current I-analyzer CSV response path; determine whether large downloads need streaming and establish a concrete, tested completion criterion.

Written by the indexing model from the issue text.

Assessment

Tech stack
django, python
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.