Displaylink makes X sluggish and displays (temporary) artifacts when moving windows

On my new HP Elitebook, while displaylink is active everything feels sluggish, just as if acceleration was switched off, even stuff that happens on the monitor directly connected to the PC.

Only on the monitor managed by display link, artifacts (short horizontal lines) appear when moving windows, but fortunately go away on their own within a second after movement.