nextcloud / nextcloud/fulltextsearch

Fulltextsearch doesn't add new documents from external cifs/samba storage

Open
#301 47 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
PHP
Stars
234
Forks
64
Avg merge
6h 18m
Merged PRs (30d)
10

Description

Hi,
may be this is just a configuration issue.
I'm using nextcloud/owncloud already for a long time at least since version 6. Now I'm on Nextcloud 13.0.1 and recently (on version 12) changed from Nextant to elasticsearch.

Indexing of local files stored in Nextcloud itself works as a charme. But when it comes to indexing files on external mounted smb shares new files are not recognized as new ans thus not indexed.

Just a few remarks about my installation.

OS: Ubuntu 16.04 (i7-3773 @3.4 Ghz, 32GB RAM)
DB: Postgres 10
Webserver: Nginx

Elasticsearch 6.2.3 in Docker container with indices on SSD

Nextcloud cron selected for background job processing (not Ajax or webcron)

crontab
*/15  *  *  *  * www-data php -f /var/www/nextcloud/cron.php
*/17  *  *  *  * www-data php -f /var/www/nextcloud/occ files:scan --all --quiet
systemd daemon for live indexing
[Unit]
Description=Elasticsearch Worker for Nextcloud Fulltext Search
After=network.target

[Service]
User=www-data
Group=www-data
WorkingDirectory=/var/www/nextcloud
ExecStart=/usr/bin/php /var/www/nextcloud/occ fulltextsearch:live
Nice=19
Restart=always

[Install]
WantedBy=multi-user.target

All fulltext apps on most recent version 0.61 except Full text search - Files which is on 0.60 due to the lack of a newer version

Any help would be greatly appreciated.

Many thanks in advance.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the difference between local files and files on the external SMB share using the mentioned occ files:scan --all --quiet and occ fulltextsearch:live commands, while checking the Elasticsearch worker configuration. Done means newly added external-share files are detected and indexed, with the relevant failure or configuration cause identified.

Written by the indexing model from the issue text.

Assessment

Tech stack
elasticsearch, php
Domain
backend, search
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.