[Bug]: Hidden "advanced" widgets affect node minimum size

### Frontend Version

1.12.1

### Expected Behavior

When advanced widgets are hidden, ComfyUI shouldn't prevent me from resizing the node to get rid of the empty space left behind.

### Actual Behavior

The invisible widgets affect the minimum size of the node.


### Steps to Reproduce

This behaviour is much easier to see with a node that has more than one advanced input, but even the normal Load CLIP node has this behaviour. Just add one to a workflow and compare its bottom padding to a LoRALoader node for example; there's more empty space.

You can also try resizing the CLIPLoader node to remove the space, but it immediately snaps back.

### Debug Logs

```powershell
Not relevant
```

### Browser Logs

No useful output, just a version and two messages from creating a new workflow. No new output appears when resizing or creating new nodes.

### Setting JSON

Defaults; I removed the entire file for testing.

### What browsers do you use to access the UI ?

Mozilla Firefox, Google Chrome

### Other Information

_No response_

┆Issue is synchronized with this [Notion page](https://www.notion.so/Issue-4728-Bug-Hidden-advanced-widgets-affect-node-minimum-size-2476d73d365081e7b9f3c1af42c308c5) by [Unito](https://www.unito.io)