dotnet / dotnet/machinelearning

Does ml.net add a pipeline similar to nvidia deepstream?

Open
#5,728 1 comment 1 reaction 0 assignees View on GitHub
area-Vision enhancement Priority:3
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

In real-time streaming image analysis, such as rtmp and rtsp, we use emgucv, opencvsharp... or other tools to pull the stream, and capture the image in it for object detection and object classification. Video stream -> GPU decoding -> CPU conversion image format -> ML.net GPU detection, and then returns the result -> C# statistics and drawing the box.

This process seems inefficient and the CPU usage is very high. If ML.net's pipelines can pull images -> detection -> drawing are all done on the GPU, it should greatly reduce the load.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.