ckan / ckan/ideas

Make harvester implementation simpler/more reliable

Open
#80 9 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
39
Forks
1
PR merge metrics
No merged PRs in 30d

Description

The harvester extension has good interfaces for viewing job progress and submitting jobs, but implementing reliable harvesting jobs is tricky and when a job stops it can be hard to debug the cause.

Can we fix or replace the current harvester back end to make it easier to extend and debug?

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names the harvester extension and its backend but does not identify files, tests, or entry points. Start by locating the harvester implementation and reviewing how job progress, submission, stopping, and failure reporting work. Done means the backend is easier to extend and the cause of stopped jobs can be diagnosed reliably.

Written by the indexing model from the issue text.

Assessment

Domain
backend
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.