Cannot aggregate Labels2DModel by ShapesModel

Hi @LucaMarconato ! I got an error when I use aggregate() to aggregate a label layer by a shape layer.

Here is my code:

The label layer in codex_sdata was created by code below:

segmentation = iio.imread(data_dir / '3-D2_segmentation_borders.tiff')
labels = { 'labels': sd.models.Labels2DModel.parse(segmentation, dims=("y", "x")) }
sdata = sd.SpatialData(table=table, labels=labels, images=images)

In addition, following the conclusion of last Thursday's community meeting, I sent you an email with the subject 'Inquiry Regarding CODEX Data and High-Resolution Visium Image Alignment.' It contained attachments with the test data and scripts I provided. I wanted to confirm whether you received that email?

Start by reproducing the reported aggregate() operation using the Labels2DModel.parse(segmentation, dims=("y", "x")) setup and the label and shape layers shown in the issue. Inspect the resulting error and determine what is needed for aggregation to complete successfully; done means a Labels2DModel can be aggregated by a ShapesModel without the reported failure.