0surface / 0surface/arxiveprior

Implement Extract task processing

Open
#19 0 comments 0 reactions 1 assignee Claimed by @0surface View on GitHub
Dominant language
C#
Stars
1
Forks
0
PR merge metrics
No merged PRs in 30d

Description

**Simplified Extract work flow for archive background task**

- service is triggered
- service checks database for the last archive task
- if last unsuccessful, retry based on criteria (TODO later)
- if success, set the next query parameters and save task & task items to database
- Fetch task items and execute fetch-transform-persist operations
- update task items database records
- if failure, fail gracefully (TODO)
- when success update task database
- Emit event

Contributor guide

No contributing guide indexed for this repository

Research direction

Look for the archive background task service and the database models for tasks and task items. Understand the fetch-transform-persist operations and how events are emitted. The work involves setting up a new processing flow, so start by examining existing services and the data layer to see how tasks are currently managed.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, csharp
Domain
backend, data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.