No predictions from setfit

I ran SetFitTrainer to train the model with 5 classes (used multi_target_strategy="one-vs-rest"). My target variable was one hot encoded. When I get my predictions on the test data, I observe for most of the rows (close to 40% of test data), I have no class predictions meaning it is not predicting any class.

Has any experienced this issue before and can provide any suggestions.

Thanks