elastic / elastic/crawler

Add HTML to Markdown functionality

Open
#197 4 comments 2 reactions 0 assignees View on GitHub
complexity:medium enhancement priority:medium
Dominant language
Ruby
Stars
224
Forks
48
Avg merge
23h 16m
Merged PRs (30d)
18

Description

### Problem Description

Markdown is the de facto standard for LLMs, so having an HTML -> markdown conversion functionality would help users who want to build RAG applications.

### Proposed Solution

Add an optional HTML -> Markdown functionality

- [ ] Configurable in the YAML file
- [ ] When configured, adds a single field to ingested document, containing the converted markdown content
- [ ] When not configured, field is not present on ingested documents at all

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.