microsoft / microsoft/sql-server-samples
WWI Generate data takes days
Nobody has claimed this yet.
- Dominant language
- PowerShell
- Stars
- 11.2k
- Forks
- 9.1k
- Avg merge
- 2d 7h
- Merged PRs (30d)
- 14
Description
I've been trying to generate the WWI data as per the documentation. The docs says it takes around 10 minutes to generate 1 year of data, however, even with 5 orders per day, it took ~25 hours to generate the data from June 1, 2016 till today. It was generated from SSMS running on Azure VM and the target DB was running on Azure SQL Server. I was trying also 1000 orders per day and that would be taking around 4 days to load all the data.
Example screenshot - data loaded from Jun 2016 till Nov 2018 after 16 hours of query running:
Is this expected? Any way we can load the data faster, or any way we can only load 2020 year?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the linked Wide World Importers data-generation documentation and the reported SSMS run against Azure SQL Server. Reproduce the generation timing with the stated order rates, then establish whether the runtime is expected and whether a supported faster or year-limited generation path is needed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, sql
- Domain
- cloud, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100