internetarchive / internetarchive/heritrix3

fetchDNS lacks timeout option

Open
#198 0 comments 0 reactions 0 assignees View on GitHub
feature request pull request welcome
Dominant language
Java
Stars
3.3k
Forks
793
Avg merge
1d 8h
Merged PRs (30d)
8

Description

Running a recent 3.3.0 snapshot, a harvest remains in the RUNNING state with 4 requests queued. These 4 requests relate to 2 domains. For each domain the dns request 'hangs'. Indeed, an nslookup requests for the given domains replies "*** Can't find firebaseio.com: No answer" So it appears that Heritrix needs to be able to timeout DNS requests.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.