odoo/odoo#196937

Created by chienandalu
Closed
label
Tecnativa:16.0-fix-googlebot-crawl-lang-redirects
head
a3b34b6eee0047771838bf3552fdf0154c5edc6a
odoo/odoo
16.0 #196937

[FIX] web: detect googlebot to avoid redirects

Those redirects can kill how the site is fetched. If a website has its default language different to english and english is available as a secondary one, the crawler bot will be always redirected to the english version. For example: mysite.info/en_US.

The effect of that is that crawlers like the Googlebot-image aren't able to validate the site icon, as they don't use any site subfolder.

This is the relevant part where the redirection should be avoided

https://github.com/odoo/odoo/blob/cce0b490090580be51fdf5a40fad2ec2b9a49401/addons/http_routing/models/ir_http.py#L452-L455

cc @Tecnativa TT48630

Set to draft for the moment to test on customer


I confirm I have signed the CLA and read the PR guidelines at www.odoo.com/submit-pr