adoptium / adoptium/log-analysis

6 Month timeframe for storing files

Open
#8 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6
Forks
2
PR merge metrics
No merged PRs in 30d

Description

Expected: index file per month, after 6 months, degenerate the files

Find way to have 1 month worth of files in one index file, and query that using what we currently have, and so on. At most 6 index files at one point in time.

Contributor guide

Open the contributing guide

Research direction

Start by locating the current index-file creation and query implementation referenced by the issue. Trace how files are grouped and queried, then define the monthly retention behavior: one index per month, with no more than six index files retained and older files degenerated after six months. Done means existing queries still work across the retained monthly indexes.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering, infrastructure
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.