Azure / Azure/azure-kusto-splunk

Files under processing to be ingested into ADX with Queued Status moves to Failed status are not retried.

Open
#5 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
3
Forks
10
PR merge metrics
No merged PRs in 30d

Description

File identified as not being currently modified -> File queued for ingestion, ingestion status set to QUEUED -> file moves to tmp folder -> later ingestion to Kusto fails due to mapping error (lets assume).

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the ingestion flow from the QUEUED status through the move to the tmp folder and the later Azure Data Explorer failure. Reproduce the mapping-error case if possible; done means files that fail after QUEUED are retried rather than remaining permanently failed.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, python
Domain
backend, data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.