awslabs / awslabs/python-deequ

pydeequ on Azure Databricks running profiler getting keyerror

Open
#148 8 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Jupyter Notebook
Stars
826
Forks
158
PR merge metrics
No merged PRs in 30d

Description

Code:
from pydeequ.profiles import *

result = ColumnProfilerRunner(spark) \
.onData(df) \
.run()

for col, profile in result.profiles.items():
print(profile)

Error:
KeyError: 'StringColumnProfile'
---------------------------------------------------------------------------
KeyError Traceback (most recent call last)
File :5
1 from pydeequ.profiles import *
3 result = ColumnProfilerRunner(spark) \
4 .onData(df) \
----> 5 .run()
7 for col, profile in result.profiles.items():
8 print(profile)

Data Types is mostly string and decimal

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.