internetarchive / internetarchive/gowarc

Write WARC-Truncated record for oversized streaming payload instead of discarding it completely

Open
#138 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
55
Forks
12
Avg merge
10d 2h
Merged PRs (30d)
1

Description

https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1-annotated/#warc-truncated

Contributor guide

No contributing guide indexed for this repository

Research direction

Read the linked WARC 1.1 specification first, then locate gowarc's handling of oversized streaming payloads. Done means the payload is represented by a WARC-Truncated record instead of being discarded completely.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.