HumanSignal / HumanSignal/label-studio

cannot resolve empty values in timeseries csv files

Open
#8,251 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
28.3k
Forks
3.7k
Avg merge
14h
Merged PRs (30d)
15

Description

**Describe the bug**
For timeseries csv, if there are some data or channels have missing values, label studio cannot resolve and report errors.

**To Reproduce**
Sample csv file:
```csv
X,Y,Z,Roll,Pitch,Yaw,Residual,Rot[0],Rot[1],Rot[2],Rot[3],Rot[4],Rot[5],Rot[6],Rot[7],Rot[8]
,,,-0.11787,,,,,,,,,,,,
,,,-0.10721,,,,,,,,,,,,
,,,-0.11698,,,,,,,,,,,,
,,,-0.1116,,,,,,,,,,,,
```

When labeling, it will display two same errors like:
```
Problems with parsing CSV: Column names count differs from data columns count. Columns: x, y, z, roll, pitch, yaw, residual, rot[0], rot[1], rot[2], rot[3], rot[4], rot[5], rot[6], rot[7], rot[8]; Data: ,,,-0.11787,,,,,,,,,,,, ; Separator: ",".
URL: ****************
```

**Expected behavior**
Empty values can be resolved as `NaN`, where the missing values will be displayed as `NaN` in charts. Sample csv file:
```csv
X,Y,Z,Roll,Pitch,Yaw,Residual,Rot[0],Rot[1],Rot[2],Rot[3],Rot[4],Rot[5],Rot[6],Rot[7],Rot[8]
NaN,NaN,NaN,-0.11787,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN
NaN,NaN,NaN,-0.10721,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN
NaN,NaN,NaN,-0.11698,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN
NaN,NaN,NaN,-0.1116,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN,NaN
```

Image

PS: `NULL` also can be resolved, where the missing values will be displayed as `NaN` in charts, too. Sample csv file:
```csv
X,Y,Z,Roll,Pitch,Yaw,Residual,Rot[0],Rot[1],Rot[2],Rot[3],Rot[4],Rot[5],Rot[6],Rot[7],Rot[8]
NULL,NULL,NULL,-0.11787,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL
NULL,NULL,NULL,-0.10721,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL
NULL,NULL,NULL,-0.11698,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL
NULL,NULL,NULL,-0.1116,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.