NASA-IMPACT/veda-data-airflow

View on GitHub

Airflow implementation of ingest pipeline for VEDA STAC data

Stars: 15
Forks: 6
Open beginner issues: 0
Indexed issues: 54
Avg merge: 1d 4h
Merged PRs (30d): 1

Dominant language: Python
License: No license data
Last GitHub push: Sep 15, 2026
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

54 open issues indexed

Investigate Task Instance State FAILED - "Task is in the 'running' state" Open

NASA-IMPACT/veda-data-airflow#512 · 1 assignee · Opened Sep 10, 2026
Update veda_vector_ingest to be fault tolerant Open

NASA-IMPACT/veda-data-airflow#511 · 2 comments · 1 assignee · Opened Sep 9, 2026
Collection string requirements for vector ingest DAG Open

Difficulty 3/5 1-2 days Newbie friendliness 66/100

NASA-IMPACT/veda-data-airflow#505 · Opened Aug 19, 2026
Append observations from many CSVs to a single feature collection Open

NASA-IMPACT/veda-data-airflow#504 · 10 comments · 2 reactions · 3 assignees · Opened Aug 19, 2026
Fix dry_run for veda-discover workflow Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

NASA-IMPACT/veda-data-airflow#469 · Opened Jul 1, 2026
Keycloak provider evaluated (either implemented or documented in a new issue for later) Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NASA-IMPACT/veda-data-airflow#456 · Opened Jun 15, 2026
Set AWS_REQUEST_PAYER for DAAC access Open

NASA-IMPACT/veda-data-airflow#453 · 7 comments · 2 assignees · Opened Jun 8, 2026
Triage STAC datetime metadata issue Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

NASA-IMPACT/veda-data-airflow#450 · Opened May 20, 2026
Deploy Airflow 3.0 to production Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

NASA-IMPACT/veda-data-airflow#446 · Opened Apr 16, 2026
When start/end datetime is provided, nominal datetime should be `null` or equal to start_datetime Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

NASA-IMPACT/veda-data-airflow#438 · Opened Apr 9, 2026
Pin GitHub Actions to SHA digests (zizmor unpinned-uses) Open

Difficulty 2/5 1-3 hours Newbie friendliness 74/100

NASA-IMPACT/veda-data-airflow#434 · Opened Apr 2, 2026
`terraform plan` output summary Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

NASA-IMPACT/veda-data-airflow#428 · 1 reaction · Opened Mar 16, 2026
Securing Delete Collection DAG Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NASA-IMPACT/veda-data-airflow#425 · Opened Mar 7, 2026
Create Recurring S3 Transfer DAG including COG, nodata validation Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

NASA-IMPACT/veda-data-airflow#419 · 1 comment · Opened Feb 16, 2026
SM2A UI should display the currently deployed release Open

NASA-IMPACT/veda-data-airflow#413 · 1 comment · 2 reactions · 1 assignee · Opened Dec 11, 2025
Identify solutions for updating collections with a rolling window Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

NASA-IMPACT/veda-data-airflow#405 · 1 comment · 2 reactions · Opened Oct 14, 2025
Create and import default DAG parameters Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

NASA-IMPACT/veda-data-airflow#401 · Opened Sep 11, 2025
Document how to use exact datetime from filename in dataset config Open

Difficulty 1/5 1-3 hours Newbie friendliness 62/100

NASA-IMPACT/veda-data-airflow#395 · 1 comment · Opened Aug 14, 2025
Configure webhooks for slack alerts Open

NASA-IMPACT/veda-data-airflow#393 · 1 comment · 4 assignees · Opened Aug 11, 2025
CICD: Automate Release Documentation with Conventional Commits Open

NASA-IMPACT/veda-data-airflow#390 · 1 assignee · Opened Jul 29, 2025
Managing Security Issues: Maintenance of Images Open

question

Difficulty 5/5 Over a week Newbie friendliness 35/100

NASA-IMPACT/veda-data-airflow#356 · 2 comments · Opened Apr 16, 2025
Create 'Advanced Configuration' docs for customizing SM2A deployments Open

NASA-IMPACT/veda-data-airflow#340 · 1 assignee · Opened Mar 27, 2025
Strip datetime_range before creating collection Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

NASA-IMPACT/veda-data-airflow#308 · Opened Mar 6, 2025
Add Slack Notification to SM2A Open

enhancement

NASA-IMPACT/veda-data-airflow#305 · 1 comment · 1 assignee · Opened Mar 3, 2025
Remove legacy workflow-api attributes, comments, and unsupported tasks from SM2A [tech debt] Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NASA-IMPACT/veda-data-airflow#299 · 1 comment · Opened Feb 19, 2025
Use STAC transactions instead of Ingest API in Submit STAC Util Open

NASA-IMPACT/veda-data-airflow#288 · 2 comments · 1 assignee · Opened Jan 24, 2025
New ingestion DAG using asset prediction (CMIP6 Data) Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

NASA-IMPACT/veda-data-airflow#278 · Opened Jan 16, 2025
Update workflows api schema to include providers, assets Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

NASA-IMPACT/veda-data-airflow#273 · Opened Dec 19, 2024
Use python 3.11 for SM2A workers Open

enhancement

NASA-IMPACT/veda-data-airflow#270 · 1 comment · 1 assignee · Opened Dec 10, 2024
Add Role-Based Permissions to Trigger Specific Airflow DAGs Open

NASA-IMPACT/veda-data-airflow#269 · 1 comment · 1 reaction · 1 assignee · Opened Dec 10, 2024
Add optional transfer step to dataset DAG Open

NASA-IMPACT/veda-data-airflow#256 · 2 comments · 1 assignee · Opened Nov 12, 2024
Cutover from workflows API to DAG Launcher Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NASA-IMPACT/veda-data-airflow#234 · 3 comments · Opened Oct 7, 2024
Modify the DAGs to remove ECS operator references Open

NASA-IMPACT/veda-data-airflow#232 · 1 comment · 1 assignee · Opened Oct 6, 2024
Add Makefile to veda-data-airflow Open

enhancement

NASA-IMPACT/veda-data-airflow#221 · 1 comment · 1 assignee · Opened Aug 19, 2024
Discovery endpoint should not fail when id_template not in request Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

NASA-IMPACT/veda-data-airflow#194 · 1 comment · Opened Jul 20, 2024
Dataset/publish endpoint should not require optional parameters Open

bug

NASA-IMPACT/veda-data-airflow#193 · 1 assignee · Opened Jul 20, 2024
Basic ingest testing Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

NASA-IMPACT/veda-data-airflow#184 · 2 comments · Opened Jul 9, 2024
Fix /list-workflows endpoint Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

NASA-IMPACT/veda-data-airflow#169 · 1 comment · Opened Jun 18, 2024
Throw exception in DAG if status not 2xx Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

NASA-IMPACT/veda-data-airflow#165 · 1 reaction · Opened Jun 13, 2024
Fix origin and distribution api/workflow behavior to cloudfront distribution Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

NASA-IMPACT/veda-data-airflow#164 · 1 comment · Opened Jun 13, 2024
Troubleshoot and fix /list-workflows and /discovery-executions Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

NASA-IMPACT/veda-data-airflow#163 · Opened Jun 4, 2024
Add unit tests around utils functions in veda_data_pipeline/utils Open

enhancement

NASA-IMPACT/veda-data-airflow#152 · 1 assignee · Opened May 21, 2024
Add test to ensure that DAGs are valid Open

enhancement

NASA-IMPACT/veda-data-airflow#148 · 1 assignee · Opened May 8, 2024
Add networking configuration to workflows API lambda Open

NASA-IMPACT/veda-data-airflow#146 · 1 assignee · Opened Apr 30, 2024
Document examples of different ingestion workflows Open

NASA-IMPACT/veda-data-airflow#137 · 1 assignee · Opened Apr 18, 2024
Implement workflows-api auth login from swagger Open

NASA-IMPACT/veda-data-airflow#134 · 2 comments · 1 assignee · Opened Apr 5, 2024
Reconcile validations with ingest-api Open

NASA-IMPACT/veda-data-airflow#113 · 2 comments · 1 assignee · Opened Feb 29, 2024
Include ingestor dataset publish workflows in veda-data-airflow Open

NASA-IMPACT/veda-data-airflow#105 · 1 assignee · Opened Feb 7, 2024
Add workflow to verify asset availability Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

NASA-IMPACT/veda-data-airflow#101 · 1 reaction · Opened Sep 22, 2023
Fix deployment of cogification image to ECR Open

bug

NASA-IMPACT/veda-data-airflow#94 · 1 assignee · Opened Sep 6, 2023

NASA-IMPACT/veda-data-airflow

Get new issues in your inbox