NYCPlanning/data-engineering

View on GitHub

Primary repository for NYC DCP's Data Engineering team

Stars: 43
Forks: 3
Open beginner issues: 0
Indexed issues: 153
Avg merge: 23h 3m
Merged PRs (30d): 44

Dominant language: Python
License: MIT
Last GitHub push: Sep 19, 2026
Latest indexed: Sep 20, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

153 open issues indexed

Scheduled Action Failure - ⚙️ Nightly QA Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

NYCPlanning/data-engineering#2643 · Opened Sep 20, 2026
KPDB - CD and CT aggregations use water-included boundaries, so Brooklyn waterfront projects land in Manhattan Open

db-knownprojects

Difficulty 4/5 3-5 days Newbie friendliness 48/100

NYCPlanning/data-engineering#2633 · Opened Sep 15, 2026
KPDB - phasing uses current_date so a pinned recipe doesn't rebuild the same numbers Open

db-knownprojects

Difficulty 2/5 1-3 hours Newbie friendliness 74/100

NYCPlanning/data-engineering#2629 · Opened Sep 14, 2026
db-developments 26Q2.1 QA Draft 1 Open

db-developments QA

NYCPlanning/data-engineering#2628 · 1 assignee · Opened Sep 14, 2026
minio client downloads return 410; drop mc or repoint the install Open

platform

Difficulty 4/5 3-5 days Newbie friendliness 50/100

NYCPlanning/data-engineering#2627 · 1 comment · Opened Sep 13, 2026
Scheduled Action Failure - Ingest - 📁 ArcGIS Feature Server Updates Open

ingest/library

Difficulty 3/5 1-2 days Newbie friendliness 35/100

NYCPlanning/data-engineering#2626 · Opened Sep 13, 2026
Ingest - archive datasets that haven't been run Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NYCPlanning/data-engineering#2624 · Opened Sep 13, 2026
FacDB - decide whether to take 5 years of dcla_culturalinstitutions changes Open

db-facilities

Difficulty 4/5 3-5 days Newbie friendliness 52/100

NYCPlanning/data-engineering#2623 · Opened Sep 12, 2026
CSCL - coincident_seg_count double-counts subway/rail crossings Open

db-cscl

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

NYCPlanning/data-engineering#2616 · Opened Sep 10, 2026
db-green-fast-track 26v2 QA Draft 1-initial-build Open

db-gft GIS QA

Difficulty 3/5 1-2 days Newbie friendliness 35/100

NYCPlanning/data-engineering#2612 · 1 comment · Opened Sep 9, 2026
Hudson Square geometry correction is patching stale KPDB input, not ZAP Open

db-knownprojects db-zap

Difficulty 4/5 3-5 days Newbie friendliness 48/100

NYCPlanning/data-engineering#2590 · Opened Aug 25, 2026
KPDB 2026 Open

data update db-knownprojects

NYCPlanning/data-engineering#2587 · 1 assignee · Opened Aug 24, 2026
housing data for CPP Open

db-knownprojects

NYCPlanning/data-engineering#2578 · 3 comments · 1 assignee · Opened Aug 20, 2026
Spatial network analysis Open

needs scoping

Difficulty 5/5 Over a week Newbie friendliness 25/100

NYCPlanning/data-engineering#2577 · Opened Aug 18, 2026
Azure POC deployment Open

needs scoping platform

NYCPlanning/data-engineering#2575 · 1 assignee · Opened Aug 18, 2026
db-pluto 26v2 QA Draft 3-newer-pts Open

db-pluto QA

Difficulty 3/5 1-2 days Newbie friendliness 25/100

NYCPlanning/data-engineering#2556 · 3 comments · Opened Aug 10, 2026
create LIFT data product Open

db-lift

NYCPlanning/data-engineering#2549 · 2 comments · 1 assignee · Opened Aug 7, 2026
COLP - migrate build SQL to dbt Open

db-colp

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NYCPlanning/data-engineering#2541 · Opened Aug 3, 2026
Checkbook - migrate build SQL to dbt Open

db-checkbook

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NYCPlanning/data-engineering#2542 · Opened Aug 3, 2026
DevDB - migrate build SQL to dbt Open

db-developments

Difficulty 5/5 Over a week Newbie friendliness 35/100

NYCPlanning/data-engineering#2539 · Opened Aug 3, 2026
KPDB - migrate build SQL to dbt Open

db-knownprojects

Difficulty 5/5 Over a week Newbie friendliness 38/100

NYCPlanning/data-engineering#2540 · 2 comments · Opened Aug 3, 2026
CBBR - migrate build SQL to dbt Open

db-cbbr

Difficulty 4/5 3-5 days Newbie friendliness 45/100

NYCPlanning/data-engineering#2538 · Opened Aug 3, 2026
FacDB - migrate build SQL to dbt Open

db-facilities

Difficulty 5/5 Over a week Newbie friendliness 35/100

NYCPlanning/data-engineering#2536 · Opened Aug 3, 2026
CEQR - migrate build SQL to dbt Open

db-ceqr

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NYCPlanning/data-engineering#2537 · Opened Aug 3, 2026
PLUTO - migrate build SQL to dbt Open

db-pluto

Difficulty 5/5 Over a week Newbie friendliness 35/100

NYCPlanning/data-engineering#2535 · Opened Aug 3, 2026
ZTL - add tests to product models Open

db-zoningtaxlots

Difficulty 3/5 1-2 days Newbie friendliness 45/100

NYCPlanning/data-engineering#2533 · Opened Aug 3, 2026
CPDB - migrate build SQL to dbt Open

db-cpdb

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NYCPlanning/data-engineering#2534 · Opened Aug 3, 2026
Lint dbt projects from shared config Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NYCPlanning/data-engineering#2531 · Opened Aug 3, 2026
GFT - add tests to staging models Open

db-gft

Difficulty 2/5 1-3 hours Newbie friendliness 68/100

NYCPlanning/data-engineering#2532 · Opened Aug 3, 2026
Compare exported geometry spatially Open

Difficulty 3/5 1-2 days Newbie friendliness 65/100

NYCPlanning/data-engineering#2530 · Opened Aug 3, 2026
Compare `.gdb.zip` build exports Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

NYCPlanning/data-engineering#2529 · Opened Aug 3, 2026
Scheduled Action Failure - CEQR - DEP CATS permits Open

db-ceqr ingest/library

Difficulty 3/5 1-2 days Newbie friendliness 35/100

NYCPlanning/data-engineering#2526 · Opened Aug 1, 2026
all SQL builds use dbt Open

platform

Difficulty 5/5 Over a week Newbie friendliness 32/100

NYCPlanning/data-engineering#2525 · Opened Jul 31, 2026
GDE data flows Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

NYCPlanning/data-engineering#2524 · Opened Jul 31, 2026
dcpy and build lifecycle improvements Open

platform

Difficulty 5/5 Over a week Newbie friendliness 25/100

NYCPlanning/data-engineering#2516 · Opened Jul 27, 2026
QA app: infrastructure and per-product reports Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

NYCPlanning/data-engineering#2515 · Opened Jul 27, 2026
CEQR Data Hub maintenance Open

db-ceqr

Difficulty 5/5 Over a week Newbie friendliness 20/100

NYCPlanning/data-engineering#2514 · Opened Jul 27, 2026
fix COLP UID Open

db-colp

Difficulty 4/5 3-5 days Newbie friendliness 48/100

NYCPlanning/data-engineering#2510 · Opened Jul 23, 2026
Scheduled Action Failure - CEQR - DEP CATS permits Open

db-ceqr ingest/library

Difficulty 3/5 1-2 days Newbie friendliness 45/100

NYCPlanning/data-engineering#2471 · 1 comment · Opened Jul 1, 2026
Scheduled Action Failure - DevDB - Data Sync and Geocoding of HPD and DOB Data Open

db-developments ingest/library

Difficulty 4/5 3-5 days Newbie friendliness 25/100

NYCPlanning/data-engineering#2467 · Opened Jun 29, 2026
CSCL - GDB data discrepancies Open

db-cscl

NYCPlanning/data-engineering#2459 · 1 comment · 1 assignee · Opened Jun 23, 2026
Standardize formatting for facility operator names Open

db-facilities

NYCPlanning/data-engineering#2454 · 1 assignee · Opened Jun 22, 2026
ACP: add SGR to FacDB Open

db-facilities

NYCPlanning/data-engineering#2387 · 1 comment · 1 assignee · Opened May 21, 2026
FacDB refactor Open

db-facilities

NYCPlanning/data-engineering#2386 · 1 assignee · Opened May 21, 2026
DevDB 26Q2 Open

data update db-developments

NYCPlanning/data-engineering#2364 · 11 comments · 1 assignee · Opened May 11, 2026
ThinLion Data and Documentation Discrepancies Open

NYCPlanning/data-engineering#2309 · 1 comment · 1 assignee · Opened Apr 7, 2026
Data Gitops in the Product Metadata Repo Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

NYCPlanning/data-engineering#2299 · 4 comments · Opened Apr 1, 2026
CSCL - Resolving Data Discrepancies Open

db-cscl

NYCPlanning/data-engineering#2278 · 1 assignee · Opened Mar 19, 2026
Decompose the UD Tools Server [Parent] Open

needs scoping

NYCPlanning/data-engineering#2260 · 3 assignees · Opened Mar 2, 2026
Scheduled Action Failure - Ingest - 📁 Open Data Routine Updates Open

ingest/library

Difficulty 3/5 1-2 days Newbie friendliness 35/100

NYCPlanning/data-engineering#2255 · Opened Mar 1, 2026

NYCPlanning/data-engineering

Get new issues in your inbox