huggingface / huggingface/dataset-viewer

DuckDB parsing errors if a column name has quotes

Open
#1,985 4 comments 0 reactions 0 assignees View on GitHub
bug name issue P2
Dominant language
Python
Stars
899
Forks
130
Avg merge
9h 26m
Merged PRs (30d)
14

Description

Not super important but affects the `split-descriptive-statistics` and the `split-duckdb-index ` jobs

e.g. this dataset has a pretty long column name that has quotes and it raises this error
```
│ INFO: 2023-10-16 12:27:43,231 - root - Compute descriptive statistics for dataset='lunaluan/chatbox3_history', config='default', split='train' │
│ INFO: 2023-10-16 12:27:43,233 - root - Downloading remote parquet files to a local directory /storage/stats-cache/81004481536938-split-descriptive-statistics-lunaluan-chatbox3_hi-0d92723b. │
│ Downloading 0000.parquet: 0%| | 0.00/6.75k [00:00

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.