Generator Functions as Data Sources?
- Dominant language
- Python
- Stars
- 1k
- Forks
- 131
- PR merge metrics
- No merged PRs in 30d
Description
In Pandas what I would often do to generate a DataFrame is to generate a list of Dictionaries, and create a DataFrame from there. Is that also possible with Odo? And would it be possible without keeping the whole list in memory?
The source of the records are normally not things like CSV or JSON, but either some computations, file exploration, etc. and I think it would be overkill or inconvenient to write a specialized backend.
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no implementation files or tests; start by locating Odo’s conversion entry points and how it handles Python data sources. Clarify whether generators of dictionaries can produce a DataFrame without retaining the full sequence, and define tests for the accepted behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- pandas, python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100