Not all labels for border tiles are downloaded

Perhaps it's best to explain my issue with a simple example:

1. I set the bounding_box in config.json to [0,0, 100,100].
2. I download labels within the bounding box
3. I download tiles of size 20*20. One of the downloaded tiles is "Tile X" with coordinates [90,90, 110,110].
4. In tile X, my model detects an "object O" at coords [105, 105, 106, 106].
5. This object is however not in labels because it is outside of the bounding box set in config.json. So it seems like a "false positive" when actually the detection is correct.

Is this known/desired?

I imagine a functionality could be added that would check coordinates of tiles and then download all labels within the tiles.