christophertubbs / christophertubbs/NWMRetroStats

Investigate direct asynchronous partition insertion

Open
#2 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

The system current tries to insert all processed rows into the parent table. Investigate the possibility of determining available partitions and inserting directly to those asynchronously in order to add another level of concurrency to save time.

Contributor guide

No contributing guide indexed for this repository

Research direction

No file, test, or entry point is named. Start by locating the code that inserts processed rows into the parent table, then inspect how partitions and asynchronous work are currently handled; done means a validated design or implementation that can insert into available partitions concurrently and demonstrates the expected time savings.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.