crate / crate/cratedb-toolkit

I/O: Improve processing and error handling

Open
#774 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
10
Forks
5
Avg merge
7d 5h
Merged PRs (30d)
7

Description

## Problem
How the I/O subsystem is currently doing its processing is, well, a bit ad hoc, and doesn't provide much guidance when it comes to informing callers about progress/status, and final outcome. /cc @hampsterx

## Proposal
I would like to introduce a first-citizen model entity that keeps track of all metadata in a typical I/O conversation in the spirit of a context object, let's just call it `JobInfo`. That context object would be used to serve multiple purposes:

- Track any job metadata and metrics.
- Emit progress/status information while the job is running.
- Be returned when a job finshes successfully.
- Be slotted into a corresponding first-citizen exception object 1:1 when an error happens during an I/O operation, or used as a callback argument to possible error handling hook functions, see GH-759.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.