nextcloud / nextcloud/fulltextsearch
indexing OpenOffice documents - first line after headline missing
Nobody has claimed this yet.
- Dominant language
- PHP
- Stars
- 234
- Forks
- 64
- Avg merge
- 6h 18m
- Merged PRs (30d)
- 10
Description
I have the following text in an openOffice document:
This is a heading followed by normal text.
Fulltextsearch finds the word: stilsicher.
Fulltextsearch does NOT find the word Löffelstiel.
But, it finds the word WortLöffelstiel
Looking at the elasticsearch / kibana console, the text is displayed as
(....)
Das erste WortLöffelstiel wird nicht gefunden – stilsicher schon.
(...)
This is reproducible for every 1st word after a headline.
Obviously the text isn't translated to clear text on indexing? This only happens for openoffice docs, not for docx documents.
I'm using the standard tokenizer.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the issue with an OpenOffice document containing a heading followed by text, then inspect the indexed text in the Elasticsearch/Kibana console. Compare the result with an equivalent DOCX document and the standard tokenizer; done means the first word after each heading is searchable, including standalone words such as “Löffelstiel”.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- elasticsearch, php
- Domain
- search
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100