ELT "hidden" in Bootstrap Modal continuously hit "onScrolledToBottom"

I replicated this issue by

1. A console.log statement inside my "onScrolledToBottom" method
2. Placed an instance of my table in my template as normal and ran it.
Console logged that onScrolledToBottom only occurred once (unless I went and actually scrolled down)
3. Placed an exact same instance of my table in the template but "hidden" inside a bootstrap modal (not even opening the modal yet)
Console logged that onScrolledToBottom fired continuously (one can see the network tab, as soon it got a result from the API, it made another call also, with "page" incremented)

I do need the modal (client's requirement) and do need to use my ELT instance (heavily used all over the app, need to keep the consistent look/feel/functionality) and the data is just too much to load all at once.