ckan / ckan/ckanext-xloader

rq child process logging broke burst click logs and unit test cli ckan jobs worker --burst logging

Open
#262 3 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
58
Forks
67
Avg merge
23h 3m
Merged PRs (30d)
8

Description

ckan (master) has moved from
rq==1.16.2
to
rq==2.3.3

There has been subtle changes under the hood where the worker thread is now spawned as a child and may not synchronise log back to click cli routing. This causes many tests looking for ``assert "Express Load completed" in stdout`` to fail even though the job passed on what occurred on inside ckan processing.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the ckan jobs worker --burst logging failure and inspect the unit tests that assert "Express Load completed" in stdout. Trace how the child worker process routes logs to the Click CLI; done means the job still succeeds and the affected stdout assertions pass.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.