blaze / blaze/odo

Generator Functions as Data Sources?

Open
#230 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1k
Forks
131
PR merge metrics
No merged PRs in 30d

Description

In Pandas what I would often do to generate a DataFrame is to generate a list of Dictionaries, and create a DataFrame from there. Is that also possible with Odo? And would it be possible without keeping the whole list in memory?

The source of the records are normally not things like CSV or JSON, but either some computations, file exploration, etc. and I think it would be overkill or inconvenient to write a specialized backend.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no implementation files or tests; start by locating Odo’s conversion entry points and how it handles Python data sources. Clarify whether generators of dictionaries can produce a DataFrame without retaining the full sequence, and define tests for the accepted behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
pandas, python
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.