MGijon / MGijon/Posts

Rebuilding my 2024 PyDay BCN ML orchestration workshop

Open
#2 0 comments 0 reactions 1 assignee View on GitHub

@MGijon is already working on this.

Since Sep 14, 2026.

Medium Public talk / workshop Research TheGraph.es
Dominant language
Python
Stars
1
Forks
0
PR merge metrics
No merged PRs in 30d

Description

Goal

Rebuild the ML orchestration workshop I gave at PyDay BCN in 2024 using a production ready architecture.

Here the repository with the original material!

Original

  • Kestra
  • MLflow
  • Python
  • Docker (docker-compose)
  • Kaggle API

2026 version

  • Kestra vs Airflow vs ... reference
  • MLflow
  • ETLs
  • PostgreSQL
  • Object storage?
  • Kubernetes
  • Observability
  • CI/CD
  • Model serving

Questions

  • What did I oversimplify in the original workshop?
  • What breaks when workflows become concurrent?
  • How should retries work?
  • How should artifacts be versioned?
  • How should models be promoted?
  • What belongs in the orchestrator vs ML platform?
  • ...

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.