internetarchive / internetarchive/doppelganger

Figure out CDX ratio of space used when ingested

Open
#2 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
12
Forks
1
PR merge metrics
No merged PRs in 30d

Description

This is as of yet undiscovered as we need to figure out how much space is saved when ingested into ScyllaDB.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are identified in the issue. Start by locating the Go ingestion path and the ScyllaDB storage configuration, then determine how CDX input and stored data sizes can be compared. Done means the space-savings ratio is defined and reported for ingested data.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.