If a fleet made up only of fighters retreats, it vanishes once it returns to the star map.

A fleet made up only of fighters can be a major threat to lone capital ships, especially using the kamikaze feature. Sadly, you can't retreat after taking down the main target to save your remaining craft, as the fleet vanishes once the battle ends.