nextcloud / nextcloud/fulltextsearch
fulltextsearch 0.6.1 not working with object storage (S3) as primary storage
Nobody has claimed this yet.
- Dominant language
- PHP
- Stars
- 234
- Forks
- 64
- Avg merge
- 6h 18m
- Merged PRs (30d)
- 10
Description
I looks like fultextsearch can't add documents when using object storage as primary storage :-(
When I run:
sudo -u www-data php /var/www/nextcloud/occ fulltextsearch:live
the output is:
- RAM: 16.301345825195
Exception: {"_index":"nextcloud","_type":"standard","_id":"files:127","_version":2,"result":"not_found","_shards":{"total":2,"successful":1,"failed":0},"_seq_no":5,"_primary_term":1}
- RAM: 18.080711364746
Exception: {"_index":"nextcloud","_type":"standard","_id":"files:127","_version":3,"result":"not_found","_shards":{"total":2,"successful":1,"failed":0},"_seq_no":6,"_primary_term":1}
- RAM: 18.080772399902
[...]
and search results always displays no result.
Installation on a DigitalOcean droplet:
- Debian 9.4
- php7.0-fpm: PHP 7.0.27-0+deb9u1
- MariaDB Ver 15.1 Distrib 10.1.26-MariaDB
My Nextcloud config.php:
<?php
$CONFIG = array (
'instanceid' => 'XXXXXXXX',
'passwordsalt' => 'XXXXXXXXXXXXXXXX',
'secret' => 'XXXXXXXXXXXXXXXX',
'trusted_domains' =>
array (
0 => 'cloud.example.com',
),
'datadirectory' => '/home/nextcloud/data',
'overwrite.cli.url' => 'https://cloud.example.com',
'dbtype' => 'mysql',
'version' => '13.0.2.1',
'dbname' => 'nextcloud',
'dbhost' => '127.0.0.1',
'dbport' => '',
'dbtableprefix' => 'oc_',
'mysql.utf8mb4' => true,
'dbuser' => 'nextcloud',
'dbpassword' => 'XXXXXXXXXXXXXXXX',
'installed' => true,
'updater.release.channel' => 'stable',
'tempdirectory' => '/home/nextcloud/data/temp',
'memcache.local' => '\\OC\\Memcache\\Redis',
'memcache.distributed' => '\\OC\\Memcache\\Redis',
'memcache.locking' => '\\OC\\Memcache\\Redis',
'redis' =>
array (
'host' => '/var/run/redis/redis.sock',
'port' => 0,
),
'log_rotate_size' => 52428800,
'logtimezone' => 'Europe/Lisbon',
'maintenance' => false,
'objectstore' =>
array (
'class' => 'OC\\Files\\ObjectStore\\S3',
'arguments' =>
array (
'bucket' => 'MyNextcloudBucket',
'key' => 'XXXXXXXXXXXXXXXX',
'secret' => 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX',
'hostname' => 'ams3.digitaloceanspaces.com',
'use_ssl' => true,
),
),
);
Fulltext search apps config:
sudo -u www-data php /var/www/nextcloud/occ fulltextsearch:check
Full text search 0.6.1
- Search Platform:
Elasticsearch 0.6.1
{
"elastic_host": "http:\/\/localhost:9200",
"elastic_index": "nextcloud"
}
- Content Providers:
Files 0.6.0
{
"files_local": "1",
"files_external": "1",
"files_encrypted": "0",
"files_federated": "0",
"files_size": "20",
"files_pdf": "1",
"files_office": "1",
"files_image": "0",
"files_audio": "0"
}
Any hints?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the reported fulltextsearch:live command and the Full text search 0.6.1 configuration, especially the Files provider and Elasticsearch endpoint. Reproduce indexing with the shown S3 object-storage configuration and inspect the reported not_found responses. Done means files stored in object storage are indexed and returned by search.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- elasticsearch, php
- Domain
- cloud, search
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100