Azure / Azure/azure-search-vector-samples

Embedded Images Treatment

Open
#83 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
910
Forks
377
PR merge metrics
No merged PRs in 30d

Description

I was able to setup and run the Azure Open AI Text Embedding function, I also used the Ingestion sample to be able to create indexes, indexers, custom skillsets and datasources.

However my PDF documents might have embedded images, so I was wondering what happens in those cases?

My discoveries:
1. Every page of each pdf is generated as an image and stored in the knowledge store.
![image](https://github.com/Azure/cognitive-search-vector-pr/assets/6962857/491ce433-c050-4129-9c3e-ea4b59319dd4)

2. When I check the content field on the index, I see many references to jpg files.

3. I see a warning on all documents for images:

Can you please explain why this is happening and how to fix it?

![image](https://github.com/Azure/cognitive-search-vector-pr/assets/6962857/119db8cc-0865-49e3-844b-6400202c1677)

4. I also have warnings in some of the file chunks:

Can you please explain why this is happening and how to fix it?

![image](https://github.com/Azure/cognitive-search-vector-pr/assets/6962857/2f43174e-e3d8-480b-9722-acf789d1f16c)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the Ingestion sample and the Azure Open AI Text Embedding setup, then inspect how PDF pages, embedded JPG references, and warnings appear in the index and knowledge store. The issue is done when the image handling and file-chunk warnings are explained and the supported fix or configuration is documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure
Domain
data, search
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.