Table Mode causes high CPU load

Once enabled the table mode causes high CPU load when simply scrolling through the lines using either up down movements or mouse wheel.

After disabling table mode, the load will still appear when scrolling though a file. After restart it is gone, until table mode is activated again.

Not sure why it needs to calculate so much when I am simply scrolling through the file and there seem to be some hooks, which remain even after deactivating the table mode, so that only a restart of VIM fixes the issue.