crate / crate/devrel-mongo-cdc-demo
Creating a CrateDB Cloud import job programmatically
- Dominant language
- Python
- Stars
- 0
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
## About
Hi. Thanks a stack for conceiving this. I was thinking [job_creator.py](https://github.com/simonprickett/mongodb-hotel-jobs/blob/main/job_creator.py) would already be about creating an import job on CrateDB Cloud, but after looking inside, I learned it is the data provisioning program for MongoDB instead.
So, back to "How to create a CrateDB Cloud import job programmatically?": Over here, there is a patch that will bring a nice SDK and CLI to the table. I think I already mentioned it elsewhere.
- https://github.com/crate/cratedb-toolkit/pull/81
It will enable you to elegantly create a CrateDB Cloud import job by wrapping it into the universal `ctk load` CLI interface to the [CTK table loader subsystem](https://cratedb-toolkit.readthedocs.io/io/), but of course you can do the same in probably 3-5 lines of code when using its Python API.
## Q & A
Is this something you would consider viable and good to have for your tutorial here? Because the patch is ~90% ready, it would not take so many efforts to wrap it up, so I could use this as a good chance to finally do it.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reading job_creator.py and the referenced CTK table loader documentation, then inspect crate/cratedb-toolkit PR #81. Determine how the tutorial should demonstrate creating a CrateDB Cloud import job through ctk load or the Python API, and consider the work done when that flow is integrated into this demo.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- mongodb, python
- Domain
- documentation
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100