CUAHSI / CUAHSI/HydroDesktop

Saving downloaded time series is slow

Open
#92 1 comment 0 reactions 0 assignees View on GitHub
CodePlex
Dominant language
C#
Stars
76
Forks
21
PR merge metrics
No merged PRs in 30d

Description

jirikadlec2[CodePlex]
DROUGHT ANALYZER issue: In Data sources, Local Data source option, I select the data service
http://hydrodata.cz/chmi-d/cuahsi_1_1.asmx

I run search (all keywords), select all sites (total 510 sites) and select quotDownload dataquot.

The download phase is fast (less than 5 minutes) but the quotsaving to databasequot phase takes more than 25 minutes for 5 years of daily precipitation and temperature at the 510 sites.

Probably, this is a performance issue in the data sites layer either in the WaterML file reading or in the quotsave time series to databasequot step.

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the reported workload: 510 sites with five years of daily precipitation and temperature data. Profile the download, WaterML reading, and save-to-database phases to locate the bottleneck; done means the saving phase is measurably improved without changing the downloaded data.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp
Domain
databases, desktop, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.