ODM Streaming Data Loader: Runs Slow
- Dominant language
- Visual Basic .NET
- Stars
- 8
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Description
kimschreuders[CodePlex]
I am loading about 76K data points each day into an ODM with about 112M data points as a scheduled task and it takes about 7 hours to run. From looking at the log file, it seems that the actual data loading only takes about an hour and the rest of the
time is spent updating the series catalog. When I run the spUpdateSeriesCatalog stored procedure, it takes less than 2 hours to completely rebuild the SeriesCatalog table. I also noticed that the log file shows that some of the series are being updated multiple
times. I have attached a copy of the log file. It seems that it should not take this long to update the series catalog and complete the data loading task. I am using version 1.1.2.2 of the ODM Streaming Data Loader.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.