dotnet / dotnet/machinelearning

Splitter/consolidator worker encountered exception while consuming source data

Open
#5,762 3 comments 0 reactions 0 assignees View on GitHub
area-Core Priority:3 question
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

### System information

Window Server R2 2012 x64
- ** .net 5

### Issue

- Image classification for 4 classes. 16000(4000 per cat) images
- Exception
- Trained model

When i had 2500 images per class it was ok. At 3500 per class 1/10 ended successful.

### Source code / logs
Splitter/consolidator worker encountered exception while consuming source data
at Microsoft.ML.Data.DataViewUtils.Splitter.Batch.SetAll(OutPipe[] pipes)
at Microsoft.ML.Data.DataViewUtils.Splitter.Cursor.MoveNextCore()
at Microsoft.ML.Data.RootCursorBase.MoveNext()
at Microsoft.ML.Trainers.TrainingCursorBase.MoveNext()
at Microsoft.ML.Trainers.LbfgsTrainerBase`3.TrainCore(IChannel ch, RoleMappedData data)
at Microsoft.ML.Trainers.LbfgsTrainerBase`3.TrainModelCore(TrainContext context)
at Microsoft.ML.Trainers.TrainerEstimatorBase`2.TrainTransformer(IDataView trainSet, IDataView validationSet, IPredictor initPredictor)
at Microsoft.ML.Trainers.TrainerEstimatorBase`2.Fit(IDataView input)
at Microsoft.ML.Data.EstimatorChain`1.Fit(IDataView input)
at MarkerModel.MarkModel.TrainModel() in C:\Users\m\source\repos\Twitter\MarkerModel\Class1.cs:line 66
at ModelTrainer.Trainer.TrainDefaultModel(ModelType type) in C:\Users\m\source\repos\Twitter\ModelTrainer\Trainer.cs:line 42

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.