Enhancement request: when deleting input ports of the Labeler job, empty ports should delete first

At the moment, deleting input ports on the Labeler job seems to delete the ports at random, regardless of whether they're empty or not. They also don't seem to follow a particular order. This becomes annoying when you want to specifically remove the input ports that are empty and therefore not useful, because there's no way to do so. You just have to guess and hope for the best. It'd be great if empty ports were removed by default, when present.