Cannot get a query to complete, or engage, with my GPU.
Open
Nobody has claimed this yet.
bug
- Dominant language
- Python
- Stars
- 32
- Forks
- 8
- Avg merge
- 3d 14h
- Merged PRs (30d)
- 8
Description
How to use GitHub
- Please use the 👍 reaction to show that you are affected by the same issue.
- Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
- Subscribe to receive notifications on status change and new comments.
Steps to reproduce
- Make query, like "How can a cat stop marking inside the house?" Or "What is the population of the US?"
- Check the GPU with 'nvidia-smi -l' and check for Chat AI responses.
- Looked in the container logs and the host logs. Couldn't see anything erroring out.
The entire AI deployment has been removed. The containers were removed when stopped, and all of the images were also removed. The Nextcloud Chat with AI isn’t operational.
Then the AppAPI was added along with a Deployment test. Nextcloud Assistant was added as an App. Then the LLM2 was added to implement AI Chat. The system is not yet querying the LLM2 container, and isn’t showing as having engaged the GPU, as seen through the nvidia-smi tool. Also have four workers running.
Expected behaviour
Something.
Actual behaviour
Seems to accrue time. Sometimes an error message for the query (a toast indicator).
Server configuration
Nextcloud 30.0.7
nginx 1.26.2
postgresql 16.6.1
PHP fpm 8.2
Ubuntu 20.04
NVidia 12Gb A2000
128Gb
List of activated apps
- activity: 3.0.0 - announcementcenter: 7.1.0 - app_api: 4.0.6 - assistant: 2.4.0 - bruteforcesettings: 3.0.0 - calendar: 5.2.0 - circles: 30.0.0 - cloud_federation_api: 1.13.0 - comments: 1.20.1 - contacts: 7.0.4 - contactsinteraction: 1.11.0 - dashboard: 7.10.0 - dav: 1.31.1 - deck: 1.14.4 - external: 5.5.2 - externalportal: 1.3.1 - facerecognition: 0.9.60 - federatedfilesharing: 1.20.0 - federation: 1.20.0 - files: 2.2.0 - files_downloadlimit: 3.0.0 - files_external: 1.22.0 - files_pdfviewer: 3.0.0 - files_reminders: 1.3.0 - files_sharing: 1.22.0 - files_trashbin: 1.20.1 - files_versions: 1.23.0 - fileslibreofficeedit: 2.0.1 - firstrunwizard: 3.0.0 - geoblocker: 0.5.16 - groupfolders: 18.1.2 - logreader: 3.0.0 - lookup_server_connector: 1.18.0 - mail: 4.3.1 - memories: 7.5.2 - nextcloud_announcements: 2.0.0 - notes: 4.11.0 - notifications: 3.0.0 - oauth2: 1.18.1 - onlyoffice: 9.7.0 - password_policy: 2.0.0 - photos: 3.0.2 - previewgenerator: 5.8.0 - privacy: 2.0.0 - provisioning_api: 1.20.0 - recognize: 8.2.0 - recommendations: 3.0.0 - related_resources: 1.5.0 - richdocumentscode: 24.4.1302 - serverinfo: 2.0.0 - settings: 1.13.0 - sharebymail: 1.20.0 - spreed: 20.1.5 - support: 2.0.0 - survey_client: 2.0.0 - suspicious_login: 8.0.0 - systemtags: 1.20.0 - tasks: 0.16.1 - text: 4.1.0 - theming: 2.6.0 - twofactor_backupcodes: 1.19.0 - updatenotification: 1.20.0 - user_status: 1.10.0 - user_usage_report: 1.14.0 - viewer: 3.0.0 - weather_status: 1.10.0 - webhook_listeners: 1.1.0-dev - whiteboard: 1.0.5 - workflow_media_converter: 1.13.5 - workflowengine: 2.12.0 ``` If you have access to your command line run e.g.: sudo -u www-data php occ app:list from within your Nextcloud installation folder ```Nextcloud configuration
{ "system": { "instanceid": "***REMOVED SENSITIVE VALUE***", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "***REMOVED SENSITIVE VALUE***", "192.168.64.234:443", "192.168.64.234:8888", "localhost:8888" ], "loglevel": 1, "session_lifetime": 86400, "datadirectory": "***REMOVED SENSITIVE VALUE***", "dbtype": "pgsql", "version": "30.0.8.1", "overwrite.cli.url": "https:\/\/server_name.net", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "5432", "dbtableprefix": "oc_", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "enable_previews": true, "enabledPreviewProviders": [ "OC\\Preview\\PNG", "OC\\Preview\\JPEG", "OC\\Preview\\JPG", "OC\\Preview\\GIF", "OC\\Preview\\BMP", "OC\\Preview\\XBitmap", "OC\\Preview\\Movie", "OC\\Preview\\PDF", "OC\\Preview\\MP3", "OC\\Preview\\TXT", "OC\\Preview\\MarkDown", "OC\\Preview\\MP4", "OC\\Preview\\MOV", "OC\\Preview\\Image", "OC\\Preview\\Photoshop", "OC\\Preview\\TIFF", "OC\\Preview\\SVG", "OC\\Preview\\HEIC", "OC\\Preview\\TIFF", "OC\\Preview\\EMF", "OCA\\Richdocuments\\Preview\\EMF" ], "htaccess.RewriteBase": "\/", "installed": true, "mail_smtpmode": "smtp", "mail_smtpsecure": "tls", "mail_sendmailmode": "smtp", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_domain": "***REMOVED SENSITIVE VALUE***", "mail_smtpauthtype": "LOGIN", "mail_smtpauth": 1, "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "587", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***", "default_phone_region": "US", "maintenance": false, "preview_max_x": 512, "preview_max_y": 512, "jpeg_quality": 60, "theme": "", "updater.release.channel": "stable", "app_install_overwrite": [ "facerecognition", "files_external_ipfs", "duplicatefinder", "caniupdate" ], "memories.exiftool": "\/usr\/share\/nginx\/nextcloud\/apps\/memories\/bin-ext\/exiftool-amd64-glibc", "memories.vod.path": "\/usr\/share\/nginx\/nextcloud\/apps\/memories\/bin-ext\/go-vod-amd64", "memories.index.path.blacklist": "\\\/(@(Recycle|eaDir|Notes( \\([0-9]+\\)*))|Notes( \\([0-9]+\\))*)\\\/", "memories.index.mode": "3", "memories.vod.ffmpeg": "\/usr\/bin\/ffmpeg", "memories.vod.ffprobe": "\/usr\/bin\/ffprobe", "memories.exiftool_no_local": true, "memories.db.triggers.fcu": true, "preview_max_memory": 4096, "preview_max_filesize_image": 256, "memcache.local": "\\OC\\Memcache\\APCu", "filelocking.enabled": true, "memcache.locking": "\\OC\\Memcache\\Redis", "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 0, "timeout": 0 }, "maintenance_window_start": 100 } }If you have access to your command line run e.g.:
sudo -u www-data php occ config:list system
from within your Nextcloud installation folder
Browser
Browser name: Firefox/Chrome/Safari/…
Browser version: 124/125/…
Operating system: Windows/Ubuntu/Mac/…
Browser log
Insert your browser log here, this could for example include:
a) The javascript console log
b) The network log
c) ...
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the LLM2 container, the AppAPI Deployment test, and the Nextcloud Assistant integration; inspect the container and host logs, then run nvidia-smi while submitting a query. Done means the query completes with a response and the GPU engagement is observable.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- docker, kubernetes, python
- Domain
- ai-infra-agents, infrastructure
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100