ImperialCollegeLondon / ImperialCollegeLondon/PyProBE

Address order of data validation when reading from cycler

Open
#315 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
56
Forks
20
PR merge metrics
No merged PRs in 30d

Description

If a file is read using the `import_from_cycler` method is missing a key column like `Time [s]`, this error is only raised after the `.parquet` file is written as the data is read into the `pyprobe.procedure.Procedure` object. As `overwrite_existing=False` by default, subsequent calls to the function repeat the error even if the original cycler file has been modified.

Contributor guide

Open the contributing guide

Research direction

Start at the import_from_cycler method and trace how the source data is read into pyprobe.procedure.Procedure and then written to the .parquet file. Confirm that missing key columns such as Time [s] are validated before writing; done means the invalid import raises the error without creating or reusing an incomplete output.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.