databrickslabs / databrickslabs/dqx
[FEATURE]: Add Demo of using DQX with DLT-META
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 459
- Forks
- 147
- Avg merge
- 2d 13h
- Merged PRs (30d)
- 9
Description
Is there an existing issue for this?
- I have searched the existing issues
Problem statement
Can someone speak to the differences between DLT-META's built-in DQ rules/execution and https://databrickslabs.github.io/dqx/? For greenfield projects requiring DQ are there good reasons to choose one over the other? Looking at GitHub, DLT-META looks to have more recent activity compared to DQX, will both have the similar resources and support from Databricks, moving forward?
Proposed Solution
Have a single recommended repo in databrickslabs.github.io for DQ, or at least pros and cons of each if an overall recommendation doesn't make sense, if both are to be equally supported.
Additional Context
No response
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by comparing DLT-META's built-in data-quality rules and execution with the DQX documentation and examples. Define whether the result should be a single recommended repository or a documented pros-and-cons comparison; done means the guidance addresses greenfield projects and the expected support and resource questions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- documentation
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100