arc53 / arc53/DocsGPT

🚀 Feature Extract and process images from source uploads

Open
#1,451 8 comments 3 reactions 3 assignees Claimed by @riyo264 View on GitHub
application backend enhancement hacktoberfest help wanted python
Dominant language
Python
Stars
18.3k
Forks
2.1k
Avg merge
1d 2h
Merged PRs (30d)
29

Description

### 🔖 Feature description

@dartpain Basically allow our AI's to eat images. good place to start is just open ai llms, even docsgpt free service should work

### 🎤 Why is this feature needed ?

Accept image and encoded base64

- Maybe user wants to send a message with an image when chatting with AI

### ✌️ How do you aim to achieve this?

- When a source has an image, for example there is a link (publicly accessible) in markdown file that was ingested, we can pass it to llm inside classic rag retriever when its generating an answer.

### 🔄️ Additional Information

_No response_

### 👀 Have you spent some time to check if this feature request has been raised before?

- [X] I checked and didn't find similar issue

### Are you willing to submit PR?

Yes I am willing to submit a PR!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.