humanmade / humanmade/aws-analytics

Add task to make old indexes read-only and merge shards

Open
#469 0 comments 0 reactions 0 assignees View on GitHub
to-refine-dev
Dominant language
JavaScript
Stars
19
Forks
1
PR merge metrics
No merged PRs in 30d

Description

Elasticsearch can be much more performant with time based indexes if the shards are merged and the index is set to be readonly after there are no more writes going to it. This should improve query times.

- https://www.elastic.co/guide/en/elasticsearch/reference/7.17/indices-forcemerge.html

Acceptance criteria:

- [ ] Indexes that are not read-only excluding the index for the current day should be force merged on a daily basis
- [ ] Make absolutely certain the current day's index is not processed - times are in UTC

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.