[Feature Request] Automatic flush of expired temporary rules (after a period)

I'd like temporary rules, e.g. block/allow for 5 minutes, to be automatically deleted after a specified period.

The behavior and UI could be similar to the automatic flushing of events after N days.

(I asked for this in another conversation quite a while back. I don't think it ever got its own feature request.)