[Safari] Video stream stops working after several camera switches

Hey,
we are currently facing a strange issue during a Safari <-> Chrome connection. When we change the stream (camera) multiple times (mostly after 5-6 times) via removeStream / addStream, the stream from the Safari user gets muted (the Chrome user receives a remote stream, but the video track is muted). The local video on Safari is still working. At this point, nothing happens when we try to change the camera again. Only a new connection makes everything working again.