blaze / blaze/datashape

Categorical optimization

Open
#229 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
189
Forks
62
PR merge metrics
No merged PRs in 30d

Description

As the `odo` issue https://github.com/blaze/odo/issues/561 mentions, a bottleneck emerged with respect to `datashape.Categorical` instantiation pointing to [this line](https://github.com/blaze/datashape/blob/master/datashape/coretypes.py#L1106), where the constructor coerces the input categories into a tuple. I wonder whether we should relax this constraint for Categorical objects, such that we could represent the underlying categories as numpy arrays, i.e. `Series.cat.categories.values`, and speed up `datashape` with respect to pandas/dask categorical discovery. cc @jbednar @teoliphant

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.