Scaling Orchestration

Hi,

I have a question regarding scaling the parallelism value.

For now, we are doing the manual way, whereby we edit the FlinkApplication YAML to change the parallelism value, apply the YAML, and let the operator transition from the old job cluster to the newly created job cluster.

Is there any recommended way to automatically orchestrate the above, similar to how HPA works in K8S, whereby HPA will kick in once the metrics exceed a certain value?

Start by reviewing how the operator handles FlinkApplication YAML changes and transitions from an old job cluster to a newly created one. Compare that flow with Kubernetes HPA behavior and determine the metrics, scaling trigger, and orchestration scope required for automatic parallelism changes.

Written by the indexing model from the issue text.