[BUG] Unable to create a struct column from an arrow dictionary array
- Dominant language
- C++
- Stars
- 9.8k
- Forks
- 1.1k
- Avg merge
- 3d 6m
- Merged PRs (30d)
- 278
Description
**Describe the bug**
We currently support converting a `category` column in `cudf` to a `DictionaryArray` in `pyarrow`:
```python
>>> import cudf
>>> s = cudf.Series([1, 2, 3], dtype='category')
>>> s.to_arrow()
-- dictionary:
[
1,
2,
3
]
-- indices:
[
0,
1,
2
]
>>> s.to_arrow().type
DictionaryType(dictionary)
```
But we don't seem to be supporting the construction of `StructDtype` & `StructColumn` from our constructors:
```python
>>> import pyarrow as pa
>>> f = pa.array([1, 2, 3])
>>> pa.StructArray.from_arrays([s.to_arrow(), f], names=['a', 'd']).type
StructType(struct, d: int64>)
>>> pa.StructArray.from_arrays([s.to_arrow(), f], names=['a', 'd'])
-- is_valid: all not null
-- child 0 type: dictionary
-- dictionary:
[
1,
2,
3
]
-- indices:
[
0,
1,
2
]
-- child 1 type: int64
[
1,
2,
3
]
>>> cudf.Series.from_arrow(pa.StructArray.from_arrays([s.to_arrow(), f], names=['a', 'd']))
Traceback (most recent call last):
File "", line 1, in
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/series.py", line 1111, in __repr__
preprocess = self.copy()
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/frame.py", line 317, in copy
new_frame._data = self._data.copy(deep=deep)
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/column_accessor.py", line 315, in copy
{k: v.copy(deep=True) for k, v in self._data.items()},
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/column_accessor.py", line 315, in
{k: v.copy(deep=True) for k, v in self._data.items()},
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/column/struct.py", line 102, in copy
result = super().copy(deep=deep)
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/column/column.py", line 419, in copy
return cast(T, result._with_type_metadata(self.dtype))
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/column/struct.py", line 134, in _with_type_metadata
names=dtype.fields.keys(),
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/dtypes.py", line 289, in fields
return {
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/dtypes.py", line 290, in
field.name: cudf.utils.dtypes.cudf_dtype_from_pa_type(field.type)
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/utils/dtypes.py", line 233, in cudf_dtype_from_pa_type
return pandas_dtype(typ.to_pandas_dtype())
File "pyarrow/types.pxi", line 200, in pyarrow.lib.DataType.to_pandas_dtype
NotImplementedError: dictionary
>>> s
0 1
1 2
2 3
dtype: category
Categories (3, int64): [1, 2, 3]
>>> s.to_frame()
0
0 1
1 2
2 3
>>> s.to_frame().to_struct()
Traceback (most recent call last):
File "", line 1, in
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/dataframe.py", line 7001, in to_struct
col = cudf.core.column.build_struct_column(
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/column/column.py", line 1655, in build_struct_column
dtype = StructDtype(
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/dtypes.py", line 281, in __init__
pa_fields = {
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/core/dtypes.py", line 282, in
k: cudf.utils.dtypes.cudf_dtype_to_pa_type(v)
File "/nvme/0/pgali/envs/cudfdev/lib/python3.8/site-packages/cudf/utils/dtypes.py", line 211, in cudf_dtype_to_pa_type
raise NotImplementedError()
NotImplementedError
```
**Steps/Code to reproduce bug**
Follow this guide http://matthewrocklin.com/blog/work/2018/02/28/minimal-bug-reports to craft a minimal bug report. This helps us reproduce the issue you're having and resolve the issue more quickly.
**Environment overview (please complete the following information)**
- Environment location: [Bare-metal]
- Method of cuDF install: [from source]
**Environment details**
Please run and paste the output of the `cudf/print_env.sh` script here, to gather any other relevant environment details
Click here to see environment details
**git***
commit 8d602b7e99c187db7063529def92a5d343a53a54 (HEAD -> 7618, upstream/branch-21.10, branch-21.10)
Author: shaneding
Date: Fri Sep 3 18:09:10 2021 -0700
Implemented bindings for `ceil` timestamp operation (#9141)
Closes #8682. Added python bindings for `ceil` operation implemented in #8942.
Authors:
- https://github.com/shaneding
Approvers:
- Ashwin Srinath (https://github.com/shwina)
- https://github.com/brandon-b-miller
URL: https://github.com/rapidsai/cudf/pull/9141
**git submodules***
***OS Information***
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.4 LTS"
NAME="Ubuntu"
VERSION="18.04.4 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.4 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic
Linux dt07 4.15.0-76-generic #86-Ubuntu SMP Fri Jan 17 17:24:28 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
***GPU Information***
Sat Sep 4 14:32:58 2021
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 460.32.03 Driver Version: 460.32.03 CUDA Version: 11.2 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 Tesla T4 On | 00000000:3B:00.0 Off | 0 |
| N/A 50C P0 28W / 70W | 384MiB / 15109MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
| 1 Tesla T4 On | 00000000:5E:00.0 Off | 0 |
| N/A 37C P8 9W / 70W | 3MiB / 15109MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
| 2 Tesla T4 On | 00000000:AF:00.0 Off | 0 |
| N/A 32C P8 11W / 70W | 3MiB / 15109MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
| 3 Tesla T4 On | 00000000:D8:00.0 Off | 0 |
| N/A 32C P8 9W / 70W | 3MiB / 15109MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| 0 N/A N/A 58965 C ...i/envs/cudfdev/bin/python 381MiB |
+-----------------------------------------------------------------------------+
***CPU***
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 64
On-line CPU(s) list: 0-63
Thread(s) per core: 2
Core(s) per socket: 16
Socket(s): 2
NUMA node(s): 2
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
Stepping: 4
CPU MHz: 2076.027
BogoMIPS: 4200.00
Virtualization: VT-x
L1d cache: 32K
L1i cache: 32K
L2 cache: 1024K
L3 cache: 22528K
NUMA node0 CPU(s): 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38,40,42,44,46,48,50,52,54,56,58,60,62
NUMA node1 CPU(s): 1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31,33,35,37,39,41,43,45,47,49,51,53,55,57,59,61,63
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts pku ospke md_clear flush_l1d
***CMake***
/nvme/0/pgali/envs/cudfdev/bin/cmake
cmake version 3.21.2
CMake suite maintained and supported by Kitware (kitware.com/cmake).
***g++***
/usr/bin/g++
g++ (Ubuntu 9.4.0-1ubuntu1~18.04) 9.4.0
Copyright (C) 2019 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
***nvcc***
/usr/local/cuda/bin/nvcc
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Sun_Feb_14_21:12:58_PST_2021
Cuda compilation tools, release 11.2, V11.2.152
Build cuda_11.2.r11.2/compiler.29618528_0
***Python***
/nvme/0/pgali/envs/cudfdev/bin/python
Python 3.8.10
***Environment Variables***
PATH : /nvme/0/pgali/envs/cudfdev/bin:/nvme/0/pgali/envs/cudfdev/bin:/nvme/0/pgali/envs/cudfdev/bin:/usr/share/swift/usr/bin:/home/nfs/pgali/bin:/home/nfs/pgali/.local/bin:/home/nfs/pgali/anaconda3/condabin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/lib/jvm/default-java/bin:/usr/share/sbt-launcher-packaging/bin/sbt-launch.jar/bin:/usr/lib/spark/bin:/usr/lib/spark/sbin:/usr/local/cuda/bin:/usr/local/cuda/bin
LD_LIBRARY_PATH : /usr/local/cuda/lib64:/usr/local/cuda/lib64::/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64
NUMBAPRO_NVVM :
NUMBAPRO_LIBDEVICE :
CONDA_PREFIX : /nvme/0/pgali/envs/cudfdev
PYTHON_PATH :
***conda packages***
/home/nfs/pgali/anaconda3/condabin/conda
# packages in environment at /nvme/0/pgali/envs/cudfdev:
#
# Name Version Build Channel
_libgcc_mutex 0.1 conda_forge conda-forge
_openmp_mutex 4.5 1_llvm conda-forge
abseil-cpp 20210324.2 h9c3ff4c_0 conda-forge
alabaster 0.7.12 py_0 conda-forge
appdirs 1.4.4 pyh9f0ad1d_0 conda-forge
argon2-cffi 20.1.0 py38h497a2fe_2 conda-forge
arrow-cpp 5.0.0 py38h327e1ba_4_cuda conda-forge
arrow-cpp-proc 3.0.0 cuda conda-forge
async_generator 1.10 py_0 conda-forge
attrs 21.2.0 pyhd8ed1ab_0 conda-forge
aws-c-cal 0.5.11 h95a6274_0 conda-forge
aws-c-common 0.6.2 h7f98852_0 conda-forge
aws-c-event-stream 0.2.7 h3541f99_13 conda-forge
aws-c-io 0.10.5 hfb6a706_0 conda-forge
aws-checksums 0.1.11 ha31a3da_7 conda-forge
aws-sdk-cpp 1.8.186 hb4091e7_3 conda-forge
babel 2.9.1 pyh44b312d_0 conda-forge
backcall 0.2.0 pyh9f0ad1d_0 conda-forge
backports 1.0 py_2 conda-forge
backports.functools_lru_cache 1.6.4 pyhd8ed1ab_0 conda-forge
beautifulsoup4 4.9.3 pyhb0f4dca_0 conda-forge
binutils_impl_linux-64 2.36.1 h193b22a_2 conda-forge
black 19.10b0 py_4 conda-forge
bleach 4.1.0 pyhd8ed1ab_0 conda-forge
bokeh 2.3.3 py38h578d9bd_0 conda-forge
brotlipy 0.7.0 py38h497a2fe_1001 conda-forge
bzip2 1.0.8 h7f98852_4 conda-forge
c-ares 1.17.2 h7f98852_0 conda-forge
ca-certificates 2021.5.30 ha878542_0 conda-forge
cachetools 4.2.2 pyhd8ed1ab_0 conda-forge
certifi 2021.5.30 py38h578d9bd_0 conda-forge
cffi 1.14.6 py38ha65f79e_0 conda-forge
cfgv 3.3.1 pyhd8ed1ab_0 conda-forge
chardet 4.0.0 py38h578d9bd_1 conda-forge
clang 11.0.0 ha770c72_2 conda-forge
clang-11 11.0.0 default_ha5c780c_2 conda-forge
clang-tools 11.0.0 default_ha5c780c_2 conda-forge
clangxx 11.0.0 default_ha5c780c_2 conda-forge
click 8.0.1 py38h578d9bd_0 conda-forge
cloudpickle 1.6.0 py_0 conda-forge
cmake 3.21.2 h8897547_0 conda-forge
cmake_setuptools 0.1.3 py_0 rapidsai
colorama 0.4.4 pyh9f0ad1d_0 conda-forge
commonmark 0.9.1 py_0 conda-forge
cryptography 3.4.7 py38ha5dfef3_0 conda-forge
cudatoolkit 11.2.72 h2bc3f7f_0 nvidia
cudf 21.10.0a0+267.g8d602b7e99.dirty pypi_0 pypi
cupy 9.4.0 py38h7818112_0 conda-forge
cython 0.29.24 py38h709712a_0 conda-forge
cytoolz 0.11.0 py38h497a2fe_3 conda-forge
dask 2021.9.0 pyhd8ed1ab_0 conda-forge
dask-core 2021.9.0 pyhd8ed1ab_0 conda-forge
dask-cudf 21.10.0a0+267.g8d602b7e99.dirty pypi_0 pypi
dataclasses 0.8 pyhc8e2a94_3 conda-forge
debugpy 1.4.1 py38h709712a_0 conda-forge
decorator 5.0.9 pyhd8ed1ab_0 conda-forge
defusedxml 0.7.1 pyhd8ed1ab_0 conda-forge
distlib 0.3.2 pyhd8ed1ab_0 conda-forge
distributed 2021.9.0 py38h578d9bd_0 conda-forge
dlpack 0.5 h9c3ff4c_0 conda-forge
docutils 0.16 py38h578d9bd_3 conda-forge
double-conversion 3.1.5 h9c3ff4c_2 conda-forge
editdistance-s 1.0.0 py38h1fd1430_1 conda-forge
entrypoints 0.3 pyhd8ed1ab_1003 conda-forge
execnet 1.9.0 pyhd8ed1ab_0 conda-forge
expat 2.4.1 h9c3ff4c_0 conda-forge
fastavro 1.4.4 py38h497a2fe_0 conda-forge
fastrlock 0.6 py38h709712a_1 conda-forge
filelock 3.0.12 pyh9f0ad1d_0 conda-forge
flake8 3.8.3 py_1 conda-forge
freetype 2.10.4 h0708190_1 conda-forge
fsspec 2021.8.1 pyhd8ed1ab_0 conda-forge
future 0.18.2 py38h578d9bd_3 conda-forge
gcc_impl_linux-64 11.1.0 h6b5115b_8 conda-forge
gflags 2.2.2 he1b5a44_1004 conda-forge
glog 0.5.0 h48cff8f_0 conda-forge
gmp 6.2.1 h58526e2_0 conda-forge
grpc-cpp 1.39.1 h850795e_1 conda-forge
heapdict 1.0.1 py_0 conda-forge
huggingface_hub 0.0.16 pyhd8ed1ab_0 conda-forge
hypothesis 6.17.4 pyhd8ed1ab_0 conda-forge
identify 2.2.13 pyhd8ed1ab_0 conda-forge
idna 2.10 pyh9f0ad1d_0 conda-forge
imagesize 1.2.0 py_0 conda-forge
importlib-metadata 4.8.1 py38h578d9bd_0 conda-forge
importlib_metadata 4.8.1 hd8ed1ab_0 conda-forge
iniconfig 1.1.1 pyh9f0ad1d_0 conda-forge
ipykernel 6.3.1 py38he5a9106_0 conda-forge
ipython 7.27.0 py38he5a9106_0 conda-forge
ipython_genutils 0.2.0 py_1 conda-forge
isort 5.6.4 py_0 conda-forge
jbig 2.1 h7f98852_2003 conda-forge
jedi 0.18.0 py38h578d9bd_2 conda-forge
jinja2 3.0.1 pyhd8ed1ab_0 conda-forge
joblib 1.0.1 pyhd8ed1ab_0 conda-forge
jpeg 9d h36c2ea0_0 conda-forge
jsonschema 3.2.0 pyhd8ed1ab_3 conda-forge
jupyter_client 7.0.2 pyhd8ed1ab_0 conda-forge
jupyter_core 4.7.1 py38h578d9bd_0 conda-forge
jupyterlab_pygments 0.1.2 pyh9f0ad1d_0 conda-forge
kernel-headers_linux-64 2.6.32 he073ed8_14 conda-forge
krb5 1.19.2 hcc1bbae_0 conda-forge
lcms2 2.12 hddcbb42_0 conda-forge
ld_impl_linux-64 2.36.1 hea4e1c9_2 conda-forge
lerc 2.2.1 h9c3ff4c_0 conda-forge
libblas 3.9.0 8_mkl conda-forge
libbrotlicommon 1.0.9 h7f98852_5 conda-forge
libbrotlidec 1.0.9 h7f98852_5 conda-forge
libbrotlienc 1.0.9 h7f98852_5 conda-forge
libcblas 3.9.0 8_mkl conda-forge
libclang-cpp11 11.0.0 default_ha5c780c_2 conda-forge
libcurl 7.78.0 h2574ce0_0 conda-forge
libdeflate 1.7 h7f98852_5 conda-forge
libedit 3.1.20191231 he28a2e2_2 conda-forge
libev 4.33 h516909a_1 conda-forge
libevent 2.1.10 hcdb4288_3 conda-forge
libffi 3.3 h58526e2_2 conda-forge
libgcc-devel_linux-64 11.1.0 h80e7780_8 conda-forge
libgcc-ng 11.1.0 hc902ee8_8 conda-forge
libgomp 11.1.0 hc902ee8_8 conda-forge
liblapack 3.9.0 8_mkl conda-forge
libllvm10 10.0.1 he513fc3_3 conda-forge
libllvm11 11.0.1 hf817b99_0 conda-forge
libnghttp2 1.43.0 h812cca2_0 conda-forge
libpng 1.6.37 h21135ba_2 conda-forge
libprotobuf 3.16.0 h780b84a_0 conda-forge
librmm 21.10.00a210904 cuda11.2_g8527317_28 rapidsai-nightly
libsanitizer 11.1.0 h56837e0_8 conda-forge
libsodium 1.0.18 h36c2ea0_1 conda-forge
libssh2 1.10.0 ha56f1ee_0 conda-forge
libstdcxx-ng 11.1.0 h56837e0_8 conda-forge
libthrift 0.14.2 he6d91bd_1 conda-forge
libtiff 4.3.0 hf544144_1 conda-forge
libutf8proc 2.6.1 h7f98852_0 conda-forge
libuv 1.42.0 h7f98852_0 conda-forge
libwebp-base 1.2.1 h7f98852_0 conda-forge
llvm-openmp 12.0.1 h4bd325d_1 conda-forge
llvmlite 0.36.0 py38h4630a5e_0 conda-forge
locket 0.2.0 py_2 conda-forge
lz4-c 1.9.3 h9c3ff4c_1 conda-forge
markdown 3.3.4 pyhd8ed1ab_0 conda-forge
markupsafe 2.0.1 py38h497a2fe_0 conda-forge
matplotlib-inline 0.1.2 pyhd8ed1ab_2 conda-forge
mccabe 0.6.1 py_1 conda-forge
mimesis 4.0.0 pyh9f0ad1d_0 conda-forge
mistune 0.8.4 py38h497a2fe_1004 conda-forge
mkl 2020.4 h726a3e6_304 conda-forge
more-itertools 8.9.0 pyhd8ed1ab_0 conda-forge
msgpack-python 1.0.2 py38h1fd1430_1 conda-forge
mypy 0.782 py_0 conda-forge
mypy_extensions 0.4.3 py38h578d9bd_3 conda-forge
nbclient 0.5.4 pyhd8ed1ab_0 conda-forge
nbconvert 6.1.0 py38h578d9bd_0 conda-forge
nbformat 5.1.3 pyhd8ed1ab_0 conda-forge
nbsphinx 0.8.7 pyhd8ed1ab_0 conda-forge
ncurses 6.2 h58526e2_4 conda-forge
nest-asyncio 1.5.1 pyhd8ed1ab_0 conda-forge
ninja 1.10.2 h4bd325d_0 conda-forge
nodeenv 1.6.0 pyhd8ed1ab_0 conda-forge
notebook 6.4.3 pyha770c72_0 conda-forge
numba 0.53.1 py38h8b71fd7_1 conda-forge
numpy 1.21.2 py38he2449b9_0 conda-forge
numpydoc 1.1.0 py_1 conda-forge
nvtx 0.2.3 py38h497a2fe_0 conda-forge
olefile 0.46 pyh9f0ad1d_1 conda-forge
openjpeg 2.4.0 hb52868f_1 conda-forge
openssl 1.1.1l h7f98852_0 conda-forge
orc 1.6.10 h58a87f1_0 conda-forge
packaging 21.0 pyhd8ed1ab_0 conda-forge
pandas 1.2.5 py38h1abd341_0 conda-forge
pandoc 1.19.2 0 conda-forge
pandocfilters 1.4.2 py_1 conda-forge
parquet-cpp 1.5.1 2 conda-forge
parso 0.8.2 pyhd8ed1ab_0 conda-forge
partd 1.2.0 pyhd8ed1ab_0 conda-forge
pathspec 0.9.0 pyhd8ed1ab_0 conda-forge
pexpect 4.8.0 pyh9f0ad1d_2 conda-forge
pickleshare 0.7.5 py_1003 conda-forge
pillow 8.3.2 py38h8e6f84c_0 conda-forge
pip 21.2.4 pyhd8ed1ab_0 conda-forge
pluggy 0.13.1 py38h578d9bd_4 conda-forge
pre-commit 2.15.0 py38h578d9bd_0 conda-forge
pre_commit 2.15.0 hd8ed1ab_0 conda-forge
prometheus_client 0.11.0 pyhd8ed1ab_0 conda-forge
prompt-toolkit 3.0.20 pyha770c72_0 conda-forge
protobuf 3.16.0 py38h709712a_0 conda-forge
psutil 5.8.0 py38h497a2fe_1 conda-forge
ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge
py 1.10.0 pyhd3deb0d_0 conda-forge
py-cpuinfo 8.0.0 pyhd8ed1ab_0 conda-forge
pyarrow 5.0.0 py38hed47224_4_cuda conda-forge
pycodestyle 2.6.0 pyh9f0ad1d_0 conda-forge
pycparser 2.20 pyh9f0ad1d_2 conda-forge
pydata-sphinx-theme 0.6.3 pyhd8ed1ab_0 conda-forge
pyflakes 2.2.0 pyh9f0ad1d_0 conda-forge
pygments 2.10.0 pyhd8ed1ab_0 conda-forge
pyopenssl 20.0.1 pyhd8ed1ab_0 conda-forge
pyorc 0.4.0 pypi_0 pypi
pyparsing 2.4.7 pyh9f0ad1d_0 conda-forge
pyrsistent 0.17.3 py38h497a2fe_2 conda-forge
pysocks 1.7.1 py38h578d9bd_3 conda-forge
pytest 6.2.5 py38h578d9bd_0 conda-forge
pytest-benchmark 3.4.1 pyhd8ed1ab_0 conda-forge
pytest-forked 1.3.0 pyhd3deb0d_0 conda-forge
pytest-xdist 2.3.0 pyhd8ed1ab_0 conda-forge
python 3.8.10 h49503c6_1_cpython conda-forge
python-dateutil 2.8.2 pyhd8ed1ab_0 conda-forge
python_abi 3.8 2_cp38 conda-forge
pytorch 1.9.0 cpu_py38h91ab35c_0 conda-forge
pytz 2021.1 pyhd8ed1ab_0 conda-forge
pyyaml 5.4.1 py38h497a2fe_1 conda-forge
pyzmq 22.2.1 py38h2035c66_0 conda-forge
rapidjson 1.1.0 he1b5a44_1002 conda-forge
re2 2021.09.01 h9c3ff4c_0 conda-forge
readline 8.1 h46c0cb4_0 conda-forge
recommonmark 0.7.1 pyhd8ed1ab_0 conda-forge
regex 2021.8.28 py38h497a2fe_0 conda-forge
requests 2.25.1 pyhd3deb0d_0 conda-forge
rhash 1.4.1 h7f98852_0 conda-forge
rmm 21.10.00a210904 cuda_11.2_py38_g8527317_28 rapidsai-nightly
s2n 1.0.10 h9b69904_0 conda-forge
sacremoses 0.0.43 pyh9f0ad1d_0 conda-forge
send2trash 1.8.0 pyhd8ed1ab_0 conda-forge
setuptools 57.4.0 py38h578d9bd_0 conda-forge
six 1.16.0 pyh6c4a22f_0 conda-forge
sleef 3.5.1 h7f98852_1 conda-forge
snappy 1.1.8 he1b5a44_3 conda-forge
snowballstemmer 2.1.0 pyhd8ed1ab_0 conda-forge
sortedcontainers 2.4.0 pyhd8ed1ab_0 conda-forge
soupsieve 2.0.1 py_1 conda-forge
spdlog 1.8.5 h4bd325d_0 conda-forge
sphinx 4.1.2 pyh6c4a22f_1 conda-forge
sphinx-copybutton 0.4.0 pyhd8ed1ab_0 conda-forge
sphinx-markdown-tables 0.0.15 pyhd3deb0d_0 conda-forge
sphinxcontrib-applehelp 1.0.2 py_0 conda-forge
sphinxcontrib-devhelp 1.0.2 py_0 conda-forge
sphinxcontrib-htmlhelp 2.0.0 pyhd8ed1ab_0 conda-forge
sphinxcontrib-jsmath 1.0.1 py_0 conda-forge
sphinxcontrib-qthelp 1.0.3 py_0 conda-forge
sphinxcontrib-serializinghtml 1.1.5 pyhd8ed1ab_0 conda-forge
sphinxcontrib-websupport 1.2.4 pyh9f0ad1d_0 conda-forge
sqlite 3.36.0 h9cd32fc_0 conda-forge
streamz 0.6.2 pyh44b312d_0 conda-forge
sysroot_linux-64 2.12 he073ed8_14 conda-forge
tblib 1.7.0 pyhd8ed1ab_0 conda-forge
terminado 0.11.1 py38h578d9bd_0 conda-forge
testpath 0.5.0 pyhd8ed1ab_0 conda-forge
tk 8.6.11 h27826a3_1 conda-forge
tokenizers 0.10.1 py38hb63a372_0 conda-forge
toml 0.10.2 pyhd8ed1ab_0 conda-forge
toolz 0.11.1 py_0 conda-forge
tornado 6.1 py38h497a2fe_1 conda-forge
tqdm 4.62.2 pyhd8ed1ab_0 conda-forge
traitlets 5.1.0 pyhd8ed1ab_0 conda-forge
transformers 4.9.2 pyhd8ed1ab_0 conda-forge
typed-ast 1.4.3 py38h497a2fe_0 conda-forge
typing-extensions 3.10.0.0 hd8ed1ab_0 conda-forge
typing_extensions 3.10.0.0 pyha770c72_0 conda-forge
urllib3 1.26.6 pyhd8ed1ab_0 conda-forge
virtualenv 20.4.7 py38h578d9bd_0 conda-forge
wcwidth 0.2.5 pyh9f0ad1d_2 conda-forge
webencodings 0.5.1 py_1 conda-forge
wheel 0.37.0 pyhd8ed1ab_1 conda-forge
xz 5.2.5 h516909a_1 conda-forge
yaml 0.2.5 h516909a_0 conda-forge
zeromq 4.3.4 h9c3ff4c_1 conda-forge
zict 2.0.0 py_0 conda-forge
zipp 3.5.0 pyhd8ed1ab_0 conda-forge
zlib 1.2.11 h516909a_1010 conda-forge
zstd 1.5.0 ha95c52a_0 conda-forge
**Additional context**
Add any other context about the problem here.
Contributor guide
Assessment
This issue has not been assessed yet.