blaze / blaze/odo

Support dict-like database migration

Open
#22 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1k
Forks
131
PR merge metrics
No merged PRs in 30d

Description

Objects like HDF5 files, SQL databases, Mongo Databases, and dicts of chunks of things might all be convertible. One could also imagine adding a very thin `Directory` type that expressed a filesystem hierarchy as a nested record type.

A natural common interchange format here might include dicts of either `chunks(DataFrame)` or `chunks(ndarray)` depending on the underlying dshape. This would also be a good place for `chunks(dynd.nd.array)`.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points and proposes several possible interchange forms. Start by reading the repository’s existing conversion and migration paths; done would require a decided dict-like representation and agreed support for the listed sources, with tests documenting that behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
mongodb, numpy, pandas, python, sql
Domain
backend, data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.