`global-auto-revert-non-file-buffers` may cause unintended buffer reverting

Activities version: 0.7
Emacs version: 29.2

In certain cases the cursor may jump to previous location when activities is active. This happens most frequently in cases when another window is opened in the same frame from a previous selection of the current window, e.g. in buffer list or Gnus summary page.

For example, I am in the buffer list window, and I select buffer A and A was opened in a new window in the same frame, and I move cursor to buffer B in the buffer list. After a few seconds, the cursor will jump back to the buffer A entry in the buffer list window (which I assume may be a side effect of activities auto save.) Similarly in Gnus summary, if I select a message which opens it in another window in the same frame, and I navigate to another message, if I wait a few seconds, it will jump back to the previous selected message.

Would be great if this doesn't happen.