Azure / Azure/azure-search-vector-samples

Bug : Unable to create merge skill from the skillset

Open
#174 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
910
Forks
377
PR merge metrics
No merged PRs in 30d

Description

I am trying to load the split the documents into chunks and create embeddings from that. To save some contextual information I want to concatenate the file name of the each document to its chunk at the starting of the chunk.

I want to have like '**chunk**: title: filename, chunk_data' in the field of chunk. how to achieve this. Normal text itself it is getting failed. Please help me resolve this

merge_skill = MergeSkill(
description="Skill to Merge text data via Skillset",
context= "/document/pages/*",
insertPreTag= " ",
insertPostTag= " ",
inputs=[
InputFieldMappingEntry(name="text", source="/document/pages/*"),
InputFieldMappingEntry(name="itemsToInsert", source="/document/metadata_storage_name"),
InputFieldMappingEntry(name="span", source=["0"]),
],
outputs=[
OutputFieldMappingEntry(name="mergedText", target_name="pageContent")
],
)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the MergeSkill configuration and InputFieldMappingEntry sources shown in the issue, then compare how the skillset handles text, itemsToInsert, and span. Reproduce the reported failure with the shown configuration and confirm that the resulting pageContent contains the filename followed by each chunk.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, python
Domain
backend, search
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.