nextcloud / nextcloud/assistant

Assistant contributor week brainstorming ideas

Open
#130 3 comments 1 reaction 2 assignees View on GitHub

@marcoambrosini is already working on this.

Since Oct 1, 2025.

enhancement
Dominant language
JavaScript
Stars
88
Forks
43
Avg merge
18h 49m
Merged PRs (30d)
3

Description

June 2026 (AI team week)

  • Context chat reduce indexing (op-in indexing for files and maybe other content providers)
  • Batching tasks in exApps
  • K8S support in more exApps
  • Add AI settings in the system report
  • Audio streaming (for audio chat for example)
  • Speaker diarisation/identification
  • True multimodality in context chat (example: one could then ask a question about the content of images)
  • Multimodality in the chat UI (accept images or audio files as input, better support for documents as input)
  • Diagram/charts generation (GraphViz, mermaid)
  • Presentation generation with LaTeX
  • Add events detected in emails directly in a calendar
  • (vague) Explore predictions (actions, document names)
  • Improve related documents or related items (between apps)
  • Make assistant accessible in Talk, dedicated user maybe, 1-1 conversations

March 2026

  • 12 Assistant should have deep knowledge of Nextcloud (technical knowledge, also internal knowledge, portal articles)
  • 11 performance: should be super fast. maybe include a switch to turn off things that make it slow? (agentic features)?
  • 11 converting artifacts: converting files, but also general artifacts e.g. turn this presentation into a Deck card
  • 11 AI should be embedded into apps, not a separate interface
  • 10 unified interface: have one chat/voice interface that can do everything, e.g. upload file and then enter the task (don’t decide first what task I wanna do). Sub-ideas: 1 chat with AI and context chat should be one tool / 2 cleaner/minimal interface - hide advanced options
  • 8 global search across all chats (or all assistant features) with Assistant to find conversations of the past
  • 7 context chat should integrate with all other apps (ATM only files and mail)
  • 5 when a task will take longer, inform the user “get a coffee 😃 “, notify on finishing the task
  • 5 translate files, e.g. presentations pptx
  • 5 Assistant should have deep knowledge of our CRM
  • 4 make it easier to do follow-up tasks, at the moment you need to copy by hand
  • 4 interaction with Assistant in Talk (not separate app)
  • 4 across Nextcloud: when highlighting text, offer AI tools/options
  • 4 ability to upload files from local system
  • 3 when it fails - it should detect the fail and automatically restart - I dont wanna see “failed”
  • 3 personalization of my experience, e.g. in general I want shorter sentences
  • 3 AI should observe my work and then suggest automations e.g. every tuesday you send the message XY in this room, should I automate this for you?
  • 2 better wording of the remember feature / make remembering clearer (e.g.) inform the user how it works
  • 2 Assistant should have deep knowledge of our github
  • 2 “Work with Text” - is a long list, should be improved, maybe with icons?
  • 1 the possibility to chat with AI with more file formats (e.g. images, PDF without OCR etc.): context chat can only extract the texts / maybe adding "select files" in the "chat with AI", or modernising "context chat" / \*ideally similar seamless experience like the popular AI tools: one chat window for all
  • 1 Personas: e.g. Marketing AI that is geared towards marketing topics
  • 1 integrating Assistant in Talk: calling in chat rooms with @assistant / separate chat room with assistant
  • 1 fullscreen option
  • 1 connect to mail app: e.g. help me answer technical questions in an email from a customer
  • 1 “selective context” better wording → select scope
  • 1 “chat with AI” → just “chat” (because the whole Assistant is AI)
  • 0 reliable search (didn’t find specific message in talk)

bugs (will not be included in prioritization):

  • context chat error “Context Chat has not finished indexing all your documents yet, it may not be able to answer your questions, yet.“

September 2025

  • better performance [everyone]
  • rich text rendering for context chat [everyone]
  • Talk in Context Chat [6]
  • rename Context Chat button to "Search your data" [6]
  • search provider for context chat, search with AI fallback [6]
  • auto-retention of AI tasks, maybe have a mass deletion option [4]
  • context menu "Assistant" option could be named differently [3]
  • file upload from computer for input field, right now [2]
  • context of the page/file that is open to take into account [2] / Make it easier to pull up the assistant with the relevant task
  • text length limit for chat messages, for now we only know after it fails (capabilities for AI providers) [2]
  • improve text generating task types, make them more useful
  • iterative processes in generating tasks

March 2025

[tasks done or out of scope have been removed]
  • a button in Nextcloud Office for translation
  • Pre-config of context chat: a sales bot for the sales handbook for asking questions, limited to a group.
  • better error handling / description
  • Talk: live translation
  • live transcription stream continues with low bandwidth (prioritized)
  • Agency: Odoo, how many leads do I not have marked as replied yet? Who is working on this customer? Which leads didn't pay their invoice yet? / Customer overview: who was in our webinar? who created support tickets? what are the feature requests?[waiting for Odoo implementing MCP]
  • External sources for Context Chat
  • videos and audio files in context chat
  • Chat: what model does it use? how performant is it compared to others in the market? make it transparent what model is used in the background and if it is good. Add links to the settings screen from the UI. And in the settings overview add links to a comparison chart. (cc @marcoambrosini )
  • Automatic transcription of voice messages and videos that are posted and audio files that are posted
  • User interface: how much resources do I consume with my feature? Footprint
  • Rewrite emails, summarize emails, when in mail client it summarizes the most important things in two sentences.

September 2024

[tasks done or out of scope have been removed]
  • Keyboard shortcut [2]
  • Recommendations from chat/notes/calendar (suggest actions that you might have forgotten, or create reminder/calendar event) [2]
  • Image editing [2]
  • Talk text check (smart correction, grammarly-like) [2]
  • Reply assistant in Talk from previous message
  • Sidebar interface / Make the modal less central (side dropdown)
  • Email classification
  • Add a chatbot context-aware helper as a popup
  • Generate talk room avatar based on the title and description
  • Image generation helper for any image input
  • Image analysis via chat AI / Images in the chat UI
  • Add word count limit and show the count in the result
  • Unified chat UI for all AI-features

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.