elastic / elastic/crawler

additional_urls field is not populated with the list of canonical URLs

Open
#261 7 comments 0 reactions 1 assignee Claimed by @Jan-Kazlouski-elastic View on GitHub
bug community-driven
Dominant language
Ruby
Stars
224
Forks
48
Avg merge
23h 16m
Merged PRs (30d)
18

Description

## Bug Description
After the crawl is performed using opencrawler, we don't seem find any field called additional_urls with the list of canonical URLs. We are very sure that the canonical URL exist on the pages.

### To Reproduce
Steps to reproduce the behavior:
1. Perform crawl
2. Notice the crawled document in the index
3. additional_urls is not found in the crawled document

## Expected behavior
additional_urls should list the canonical URLs in the crawled document

## Screenshots

## Environment

- OS: [e.g. iOS]
- Browser [e.g. chrome, safari]
- Version [e.g. 22]

## Additional context

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.