dotnet / dotnet/machinelearning
Splitter/consolidator worker encountered exception while consuming source data
- Dominant language
- C#
- Stars
- 9.4k
- Forks
- 2k
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 11
Description
### System information
Window Server R2 2012 x64
- ** .net 5
### Issue
- Image classification for 4 classes. 16000(4000 per cat) images
- Exception
- Trained model
When i had 2500 images per class it was ok. At 3500 per class 1/10 ended successful.
### Source code / logs
Splitter/consolidator worker encountered exception while consuming source data
at Microsoft.ML.Data.DataViewUtils.Splitter.Batch.SetAll(OutPipe[] pipes)
at Microsoft.ML.Data.DataViewUtils.Splitter.Cursor.MoveNextCore()
at Microsoft.ML.Data.RootCursorBase.MoveNext()
at Microsoft.ML.Trainers.TrainingCursorBase.MoveNext()
at Microsoft.ML.Trainers.LbfgsTrainerBase`3.TrainCore(IChannel ch, RoleMappedData data)
at Microsoft.ML.Trainers.LbfgsTrainerBase`3.TrainModelCore(TrainContext context)
at Microsoft.ML.Trainers.TrainerEstimatorBase`2.TrainTransformer(IDataView trainSet, IDataView validationSet, IPredictor initPredictor)
at Microsoft.ML.Trainers.TrainerEstimatorBase`2.Fit(IDataView input)
at Microsoft.ML.Data.EstimatorChain`1.Fit(IDataView input)
at MarkerModel.MarkModel.TrainModel() in C:\Users\m\source\repos\Twitter\MarkerModel\Class1.cs:line 66
at ModelTrainer.Trainer.TrainDefaultModel(ModelType type) in C:\Users\m\source\repos\Twitter\ModelTrainer\Trainer.cs:line 42
Contributor guide
Assessment
This issue has not been assessed yet.