databrickslabs / databrickslabs/ontos
[Feature]: Semantic validation checks
Open
Nobody has claimed this yet.
scope/compliance
scope/ontology
type/feature
- Dominant language
- Python
- Stars
- 212
- Forks
- 71
- Avg merge
- 4d 10h
- Merged PRs (30d)
- 43
Description
Is there an existing issue for this?
- I have searched the existing issues
Problem statement
The knowledge graph can be used to validate data processing logic.
Proposed Solution
Two checks come to mind:
- Lineage verification - Cross-check platform lineage information against the semantic model, detecting ordering issues.
- JOIN verification - Check if joined columns have the same semantic meaning
Implement these checks using the compliance feature.
Additional Context
No response
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the existing compliance feature and semantic model validation entry points; this issue names no files or tests. Done means implementing lineage verification for ordering issues and JOIN verification for semantic compatibility, with validation coverage for both checks.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100