crate / crate/devrel-mongo-cdc-demo

Creating a CrateDB Cloud import job programmatically

Open
#1 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

## About

Hi. Thanks a stack for conceiving this. I was thinking [job_creator.py](https://github.com/simonprickett/mongodb-hotel-jobs/blob/main/job_creator.py) would already be about creating an import job on CrateDB Cloud, but after looking inside, I learned it is the data provisioning program for MongoDB instead.

So, back to "How to create a CrateDB Cloud import job programmatically?": Over here, there is a patch that will bring a nice SDK and CLI to the table. I think I already mentioned it elsewhere.

- https://github.com/crate/cratedb-toolkit/pull/81

It will enable you to elegantly create a CrateDB Cloud import job by wrapping it into the universal `ctk load` CLI interface to the [CTK table loader subsystem](https://cratedb-toolkit.readthedocs.io/io/), but of course you can do the same in probably 3-5 lines of code when using its Python API.

## Q & A

Is this something you would consider viable and good to have for your tutorial here? Because the patch is ~90% ready, it would not take so many efforts to wrap it up, so I could use this as a good chance to finally do it.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading job_creator.py and the referenced CTK table loader documentation, then inspect crate/cratedb-toolkit PR #81. Determine how the tutorial should demonstrate creating a CrateDB Cloud import job through ctk load or the Python API, and consider the work done when that flow is integrated into this demo.

Written by the indexing model from the issue text.

Assessment

Tech stack
mongodb, python
Domain
documentation
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.