Empty Label files when using meta SAM using the label-studio-ml-backend

**Describe the bug**
I've labelled a dataset which has only 1 class for the purpose of semantic segmentation. The annotations are being rendered correctly in the label studio and I am able to export png and numpy binary masks.

But when I try to export the annotations in any of the format:
1. YOLO: The txt files in the labels are empty
2. COCO and PASCAL: These formats also aren't giving me any annotations

**Expected behavior**
Annotations should be exportable in all the formats

**Environment (please complete the following information):**
- OS: macOS Ventura 13.6.1 (22G313)
- Label Studio Version: 1.11.0

**Additional context**
- After annotating with SAM, I had to fix the annotations using the brush tool.
- I followed this tutorial - https://labelstud.io/blog/get-started-using-segment-anything/
- Using the semantic segmentation with masks option and not the polygon one