baobabsoluciones / baobabsoluciones/cornflow

Make schema errors more informative

Open
#573 0 comments 0 reactions 0 assignees View on GitHub
triage
Dominant language
Python
Stars
21
Forks
5
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**
As it is now, in a dag, the error cornflow creates when the data doesn't fit a given schema really lack information.
It is usually something like this:
`cornflow_client.constants.BadInstance: The instance does not match the schema:
[, , ]`

With only the wrong and expected types, it is very hard to identify where the error might be.

**Describe the solution you'd like**
We should modify this error message in order to return more information:
- name of the table where the error occur.
- name of the keys with wrong type.
- value of the wrong data.
- some way to identify the row in which the error occur (row number or first identifier of the row).

Contributor guide

Open the contributing guide

Research direction

Start by tracing the Python schema-validation path that constructs the BadInstance message for invalid DAG data. Determine how table, field, invalid value, and row identity are available at that point. Done means validation errors identify all four pieces of context without losing the existing type information.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.