ProfessionalWiki / ProfessionalWiki/Maps

Performance issues with larger amounts of data

Open
#710 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
JavaScript
Stars
78
Forks
65
Avg merge
9h 17m
Merged PRs (30d)
6

Description

Setup
Product Version
MediaWiki 1.35.6
PHP 7.4.3 (fpm-fcgi)
MariaDB 10.3.34-MariaDB-0ubuntu0.20.04.1
ICU 66.1
Elasticsearch 6.8.23
LuaSandbox 4.0.2
Lua 5.1.5
Semantic MediaWiki 4.0.2
Maps 9.0.7
Issue

This rather simple query displays an error:

Unstrip size limit exceeded (5,000,000)

{{#ask:[[Category:Correspondence]]
 |mainlabel=Institution
 |?Coordinates
 |?Author
 |?Language
 |format=map
 |limit=5000
}}

If I try to remove some printouts, to make it smaller, sometimes the message does not get displayed, but only a blank page is showing.

So the first improvement would be to fetch the problem to avoid the error and especially a blank page.

https://fina.knowledge.wiki/Test_Map

Performance

But the more general question is how to make maps that show several thousands of entries. With markerclusters, this is not a visulazation problem any more.

  • Maybe with the deferred marker?
  • Or with some kind of pre-clustering?
  • Or with a better working ajax reload (see #649)

See also #565

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the query on the linked Test_Map page and observe the unstrip-size error or blank page with a limit of 5000. Read the deferred marker pull request and related issues #649 and #565 before defining a focused approach; done should include graceful handling of large result sets and a workable map display without the reported failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
elasticsearch, javascript, lua, mariadb, php
Domain
backend, frontend, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.