openedx / openedx/platform-plugin-aspects
Evaluate transaction handling / clickhouse-sink-connector
Open
@bmtcril is already working on this.
Since Feb 25, 2025.
- Dominant language
- Python
- Stars
- 6
- Forks
- 14
- Avg merge
- 20h 24m
- Merged PRs (30d)
- 4
Description
We should evaluate whether https://github.com/Altinity/clickhouse-sink-connector is a good replacement for our MySQL based sinks. It may be a more robust solution and get around a number of issues with the current sinks & Celery saturation / transaction handling.
If it seems like it won't be a good choice for us, we should at least convert the remaining MySQL sinks to use the on_commit handler so that we can work around issues related to rollbacks, trying to read uncommitted data, etc. See this #108 for more information.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.