aws / aws/amazon-sagemaker-examples

parquet_to_recordio_protobuf.ipynb failed CI

Open
#2,511 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
11k
Forks
7k
Avg merge
8h 29m
Merged PRs (30d)
8

Description

Link to the notebook:
https://github.com/aws/amazon-sagemaker-examples/blob/master/advanced_functionality/parquet_to_recordio_protobuf/parquet_to_recordio_protobuf.ipynb

Error:

---------------------------------------------------------------------------
Exception encountered at "In [4]":
---------------------------------------------------------------------------
ModuleNotFoundError Traceback (most recent call last)
in
----> 1 from fastparquet import write
2 from fastparquet import ParquetFile
3
4 def save_as_parquet_file(dataset, filename, label_col):
5 X = dataset[0]

/opt/conda/lib/python3.7/site-packages/fastparquet/__init__.py in
3
4 from .thrift_structures import parquet_thrift
----> 5 from .core import read_thrift
6 from .writer import write
7 from . import core, schema, converted_types, api

/opt/conda/lib/python3.7/site-packages/fastparquet/core.py in
7 from thrift.protocol.TCompactProtocol import TCompactProtocol
8
----> 9 from . import encoding
10 from .

[...]

ModuleNotFoundError: No module named 'numba.experimental'

Contributor guide

Open the contributing guide

Research direction

Open advanced_functionality/parquet_to_recordio_protobuf/parquet_to_recordio_protobuf.ipynb and inspect the failing In [4] cell, beginning with its fastparquet and numba imports. Run the notebook or its CI check to reproduce the ModuleNotFoundError; done means the notebook completes without this import failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, python
Domain
data-engineering, machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.