flarum / flarum/framework

Google indexes a discussion page using content from other pages

Open
#3,370 6 comments 3 reactions 0 assignees View on GitHub
prio/low type/bug
Dominant language
PHP
Stars
6.7k
Forks
883
Avg merge
15h 16m
Merged PRs (30d)
73

Description

## Bug Report

**Current Behavior**

Google's crawler indexes page X of a discussion (discussion/?page=X) using also the text/images from other pages. This means that what Google's crawler sees doesn't always match what users see once they open that page.

**Example**

Google "ok, ma io ho fatto questi test a scopo informativo/illustrativo site:forum.fibra.click"

![image](https://user-images.githubusercontent.com/3463028/160456570-f5c15c22-1ec8-4eb5-a90c-8e39d3bc3f85.png)
Second result is [page 12](https://forum.fibra.click/d/21124-latenze-tim-professional-con-bmg?page=12), but that post belongs to [page 10](https://forum.fibra.click/d/21124-latenze-tim-professional-con-bmg?page=10)

**Expected Behavior**
Google's crawler should only look at posts on a specific page, i.e. in the above example Google should link to page 10

**Environment**
- Flarum version: 1.2.0
- Website URL: https://forum.fibra.click/

**Possible Solutions**
1. (Hacky) Disable javascript for all crawlers (limited to discussions)
2. Disable posts auto-loading for crawlers, adding a button "load more" that points to the next page
3. Disable posts auto-loading for all users, adding a button "load more" that enables posts auto-loading

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.