Disable verbose containerdebug logging in Spark Kubernetes operator

Affected Stackable version

v26.3.0

Affected Apache Spark-on-Kubernetes version

No response

Current and expected behavior

Hi all,
Is there any way to disable containerdebug when running Stackable Spark on Kubernetes?

By default, containerdebug appears to always be enabled, and it generates a large amount of unnecessary and verbose logging! Currently it seems like the spark-k8s-operator hardcodes the variable _STACKABLE_PRE_HOOK to containerdebug --output={VOLUME_MOUNT_PATH_LOG}/containerdebug-state.json --loop &.

We have tried overriding the variable _STACKABLE_PRE_HOOK by:

• spec.env with _STACKABLE_PRE_HOOK=""
• job.podOverrides.spec.containers[].env with _STACKABLE_PRE_HOOK=""
• envOverrides at role level or role group level.

However, none of these approaches appear to disable containerdebug. Is there a supported configuration option to turn it off, or is disabling it currently not possible?

Any help would be appreciated!

Possible solution

No response

Additional context

No response

Environment

No response

Would you like to work on fixing this bug?

None

Start in rust/operator-binary/src/crd/mod.rs around line 781, where _STACKABLE_PRE_HOOK is hardcoded, and trace how the listed environment and pod overrides are applied. Done means a supported configuration can disable the containerdebug hook without being overwritten, while preserving the default behavior when no override is provided.