Tacked Object goes outside screeen and then comes back

How can I handle the case in which the object I am tracking goes outside the screen? Sometimes when it reappears it is found and it starts tracking it again, but in other cases instead it starts tracking other objects when the original tracked object goes outside the screen.
Thanks