ProfessionalWiki / ProfessionalWiki/Maps
Performance issues with larger amounts of data
Nobody has claimed this yet.
- Dominant language
- JavaScript
- Stars
- 78
- Forks
- 65
- Avg merge
- 9h 17m
- Merged PRs (30d)
- 6
Description
Setup
| Product | Version |
|---|---|
| MediaWiki | 1.35.6 |
| PHP | 7.4.3 (fpm-fcgi) |
| MariaDB | 10.3.34-MariaDB-0ubuntu0.20.04.1 |
| ICU | 66.1 |
| Elasticsearch | 6.8.23 |
| LuaSandbox | 4.0.2 |
| Lua | 5.1.5 |
| Semantic MediaWiki | 4.0.2 |
| Maps | 9.0.7 |
Issue
This rather simple query displays an error:
Unstrip size limit exceeded (5,000,000)
{{#ask:[[Category:Correspondence]]
|mainlabel=Institution
|?Coordinates
|?Author
|?Language
|format=map
|limit=5000
}}
If I try to remove some printouts, to make it smaller, sometimes the message does not get displayed, but only a blank page is showing.
So the first improvement would be to fetch the problem to avoid the error and especially a blank page.
https://fina.knowledge.wiki/Test_Map
Performance
But the more general question is how to make maps that show several thousands of entries. With markerclusters, this is not a visulazation problem any more.
- Maybe with the deferred marker?
- Or with some kind of pre-clustering?
- Or with a better working ajax reload (see #649)
See also #565
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the query on the linked Test_Map page and observe the unstrip-size error or blank page with a limit of 5000. Read the deferred marker pull request and related issues #649 and #565 before defining a focused approach; done should include graceful handling of large result sets and a workable map display without the reported failure.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- elasticsearch, javascript, lua, mariadb, php
- Domain
- backend, frontend, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100