internetarchive / internetarchive/heritrix3

Keep-alive and chunked transfer is not supported

Open
#309 0 comments 0 reactions 0 assignees View on GitHub
feature request
Dominant language
Java
Stars
3.3k
Forks
793
Avg merge
1d 8h
Merged PRs (30d)
8

Description

Heritrix3 is main tool for archival websites in IA and man other organizations, but it still doesn't support Keep-alive and chunked transfer. Without it, and by default configuration settings, Heritrix3 have to open new connection for each url. That increases website loading and makes process much slower.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.