blaze / blaze/odo

Add file modes to odo

Open
#456 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1k
Forks
131
PR merge metrics
No merged PRs in 30d

Description

From http://stackoverflow.com/questions/38149288/delete-columns-from-very-large-csv-file-using-pandas-or-blaze. There does not appear to be a way to enable IO modes for odo, and the default mode appears to be the append mode. If you added a writing mode, this would make it easier to say change CSV files without having to load then into RAM.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no file, test, or entry point. Start by locating odo’s CSV writing path and its current append-mode handling, then determine how selectable write modes should behave; done means a mode can be chosen for changing CSV data without loading the entire file into RAM.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.