databrickslabs/dqx

View on GitHub

Databricks framework to validate Data Quality of pySpark DataFrames and Tables

Stars: 459
Forks: 147
Open beginner issues: 0
Indexed issues: 63
Avg merge: 2d 13h
Merged PRs (30d): 9

Dominant language: Python
License: No license data
Last GitHub push: Sep 11, 2026
Latest indexed: Sep 20, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue

Beginner friendly Everything

Open All

63 open issues indexed

Consolidate structured API error handling across the Studio UI Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

databrickslabs/dqx#1528 · Opened Sep 11, 2026
[FEATURE]: Checks for numeric value precision Open

DQX Core enhancement

databrickslabs/dqx#1520 · 1 assignee · Opened Sep 8, 2026
[FEATURE]: DQX Feedback Collection Mechanism on Alpha Releases Open

enhancement good first issue

Difficulty 5/5 Over a week Newbie friendliness 35/100

databrickslabs/dqx#1518 · 1 comment · Opened Sep 8, 2026
[FEATURE]: Profile geospatial data Open

DQX Core enhancement

databrickslabs/dqx#1514 · 2 comments · 1 assignee · Opened Sep 6, 2026
[FEATURE]: Unify parsing semantics for geospatial checks Open

DQX Core enhancement

databrickslabs/dqx#1513 · 1 assignee · Opened Sep 6, 2026
[FEATURE]: Extend 'generate_rules_from_contract' to support rules nested within array columns Open

DQX Core enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

databrickslabs/dqx#1512 · Opened Sep 6, 2026
[FEATURE]: Add support for applying DQX-native rules across all elements of an array column Open

DQX Core enhancement question

Difficulty 5/5 Over a week Newbie friendliness 38/100

databrickslabs/dqx#1511 · 4 comments · Opened Sep 6, 2026
Remove MLflow 2.x scaffolding left behind by the mlflow>=3.13 floor Open

DQX Core good first issue

databrickslabs/dqx#1508 · 4 comments · 1 assignee · Opened Sep 4, 2026
MCP coverage and integration-suite follow-ups parked from #1494 Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

databrickslabs/dqx#1506 · Opened Sep 4, 2026
Filtered compare_datasets mispairs duplicate keys Open

bug

databrickslabs/dqx#1504 · 2 comments · 1 assignee · Opened Sep 4, 2026
Add exact-fit strict-inequality/range aggregate check functions (is_aggr_greater_than, is_aggr_less_than, is_aggr_in_range, is_aggr_not_in_range) Open

DQX Core enhancement

Difficulty 3/5 1-2 days Newbie friendliness 74/100

databrickslabs/dqx#1495 · 1 comment · Opened Sep 1, 2026
Anomaly detection: no detector for metrics that move together Open

DQX Core enhancement

databrickslabs/dqx#1490 · 1 assignee · Opened Aug 28, 2026
Anomaly detection: grouped data has no scalable path to conditioning Open

DQX Core enhancement

databrickslabs/dqx#1484 · 1 assignee · Opened Aug 24, 2026
The ODCS generate_rules_from_contracts produces invalid rules for date/timestamp formats Open

bug DQX Core

databrickslabs/dqx#1483 · 3 comments · 1 assignee · Opened Aug 24, 2026
[FEATURE]: Include the number of analysis in per-check summary metrics (check_metrics) Open

DQX Core enhancement

Difficulty 3/5 1-2 days Newbie friendliness 58/100

databrickslabs/dqx#1482 · 4 comments · 1 reaction · Opened Aug 24, 2026
Column names requiring SQL identifier escaping pass validation but fail during check execution (`INVALID_IDENTIFIER`) Open

bug DQX Core

databrickslabs/dqx#1481 · 1 comment · 1 reaction · 1 assignee · Opened Aug 19, 2026
compute_rule_fingerprint doesn't include user_metadata Open

bug DQX Core

databrickslabs/dqx#1476 · 1 assignee · Opened Aug 17, 2026
Check names containing quotes or backslashes corrupt check_metrics (wrong counts, unparseable JSON) Open

databrickslabs/dqx#1474 · 1 assignee · Opened Aug 15, 2026
save_checks does not work with custom functions Open

bug DQX Core

databrickslabs/dqx#1467 · 4 comments · 1 assignee · Opened Aug 13, 2026
[FEATURE]: Generate DQX checks from ODCS "library" quality metrics (rowCount, nullValues, missingValues, invalidValues, duplicateValues) Open

enhancement

databrickslabs/dqx#1424 · 3 comments · 1 reaction · 1 assignee · Opened Aug 4, 2026
Unify profiler/LLM secret handling onto DQSecret + SecretResolver Open

DQX Core enhancement

Difficulty 4/5 3-5 days Newbie friendliness 55/100

databrickslabs/dqx#1421 · Opened Aug 4, 2026
Support Unity Catalog secrets in DQSecret credential references Open

DQX Core enhancement

Difficulty 4/5 3-5 days Newbie friendliness 50/100

databrickslabs/dqx#1420 · 1 comment · Opened Aug 4, 2026
[FEATURE]: Include rule_fingerprint and user_metadata in per-check summary metrics (check_metrics) Open

enhancement triage

databrickslabs/dqx#1409 · 3 comments · 1 assignee · Opened Aug 3, 2026
[FEATURE]: Email alert delivery for DQX actions Open

enhancement triage

Difficulty 5/5 Over a week Newbie friendliness 30/100

databrickslabs/dqx#1400 · Opened Jul 31, 2026
[FEATURE]: Guard SQL statements Open

DQX Core enhancement

databrickslabs/dqx#1362 · 3 comments · 1 assignee · Opened Jul 22, 2026
[FEATURE]: Profile classification support Open

DQX Core enhancement

databrickslabs/dqx#1343 · 2 comments · 1 assignee · Opened Jul 18, 2026
[FEATURE]: Profile rules from UC metadata using LLMs Open

DQX Core enhancement

databrickslabs/dqx#1329 · 3 comments · 1 reaction · 1 assignee · Opened Jul 15, 2026
[FEATURE]: Bump tests to use available model Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

databrickslabs/dqx#1307 · Opened Jul 6, 2026
[FEATURE]: Promoting / Copying data quality checks from test to prod within DQX Studio Open

DQX App enhancement

Difficulty 5/5 Over a week Newbie friendliness 45/100

databrickslabs/dqx#1290 · 1 comment · Opened Jun 30, 2026
[FEATURE]: Upstream and downstream lineage Open

enhancement

databrickslabs/dqx#1266 · 8 comments · 1 assignee · Opened Jun 23, 2026
[FEATURE]: Add Polish language to DQX Studio Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 58/100

databrickslabs/dqx#1237 · 1 comment · Opened Jun 10, 2026
[FEATURE]: Add German language to DQX Studio Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

databrickslabs/dqx#1233 · 1 comment · Opened Jun 9, 2026
[FEATURE]: Add error_if & warn_if settings Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

databrickslabs/dqx#1214 · 4 comments · 1 reaction · Opened Jun 1, 2026
[FEATURE]: data frame with special character columns Open

enhancement

databrickslabs/dqx#1202 · 9 comments · 1 assignee · Opened May 26, 2026
[BUG]: Summary metrics feature does not work with MERGE statement Open

bug DQX Core

databrickslabs/dqx#1185 · 4 comments · 1 assignee · Opened May 20, 2026
[FEATURE]: Add status to summary & check_metrics Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 55/100

databrickslabs/dqx#1166 · 4 comments · Opened May 8, 2026
[FEATURE]: dataset level checks next to row level checks Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 38/100

databrickslabs/dqx#1150 · 8 comments · 2 reactions · Opened May 4, 2026
[BUG]: Row-based approach to errors/warnings fails on empty dataframes Open

bug DQX Core

Difficulty 4/5 3-5 days Newbie friendliness 48/100

databrickslabs/dqx#1093 · 3 comments · Opened Mar 23, 2026
[FEATURE]: Extend profiler with additional metrics Open

enhancement good first issue

databrickslabs/dqx#1067 · 10 comments · 1 assignee · Opened Mar 12, 2026
[FEATURE]: Integration with Data Quality Monitoring - Phase 1 Open

enhancement

databrickslabs/dqx#1057 · 3 comments · 1 reaction · 1 assignee · Opened Mar 3, 2026
[FEATURE]: Incremental Snapshots for Valid and Quarantine? Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

databrickslabs/dqx#1047 · 10 comments · Opened Feb 26, 2026
[FEATURE]: Interactive Threshold Tuning Workflow for Anomaly Detection Open

DQX App enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

databrickslabs/dqx#1032 · Opened Feb 12, 2026
[FEATURE]: AI Assisted Tuning of ML-based Anomaly Detection DQ Checks Open

DQX Core enhancement

databrickslabs/dqx#1030 · 1 assignee · Opened Feb 12, 2026
[FEATURE]: Support OpenDataContractStandard directly in contract-based rule generation Open

DQX Core enhancement question

Difficulty 4/5 3-5 days Newbie friendliness 48/100

databrickslabs/dqx#1028 · 1 comment · Opened Feb 10, 2026
[FEATURE]: Include field constraints for richer LLM context for AI Assisted DQ Rule Generation Open

enhancement Q1 2026

Difficulty 5/5 Over a week Newbie friendliness 25/100

databrickslabs/dqx#936 · 1 reaction · Opened Nov 18, 2025
[FEATURE]: Improve validation of AI-Assisted Rules Generation Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

databrickslabs/dqx#924 · 1 comment · Opened Nov 11, 2025
[FEATURE]: Identify duplicate or similar tables with profiler Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

databrickslabs/dqx#611 · 2 reactions · Opened Oct 13, 2025
[FEATURE]: Demos for different industries - Insurance Open

documentation Q2 2026

Difficulty 4/5 3-5 days Newbie friendliness 35/100

databrickslabs/dqx#555 · 1 comment · Opened Aug 29, 2025
[FEATURE]: Add Demo of using DQX with DLT-META Open

documentation

Difficulty 5/5 Over a week Newbie friendliness 35/100

databrickslabs/dqx#552 · 4 comments · Opened Aug 28, 2025
[FEATURE]: Support for applying a check across all columns Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

databrickslabs/dqx#549 · 1 reaction · Opened Aug 28, 2025

databrickslabs/dqx

Get new issues in your inbox