User-agent: * Sitemap: https://www.fleurdecafe.nl/sitemap.xml ############## # custom # ############## # robots.txt — v1 User-agent: * # 1) Odoo system/account routes (block) Disallow: /web Disallow: /web/ Disallow: /my Disallow: /my/ Disallow: /website Disallow: /website/ # 2) Shop checkout/cart/compare/wishlist/payment (block) Disallow: /shop/cart Disallow: /shop/checkout Disallow: /shop/compare Disallow: /shop/wishlist Disallow: /shop/payment # 3) Search routes (block) Disallow: /website/search Disallow: /shop/search # 4a) Parameters — gevonden in crawl (staging) Disallow: /*order= Disallow: /*category= Disallow: /*min_price= Disallow: /*max_price= # 4b) Parameters — Odoo best practice (preventief blokkeren) Disallow: /*search= Disallow: /*q= Disallow: /*?* # brede fallback om alle ongewenste varianten te blokkeren # 5) Assets whitelisting (with or without querystrings) # Keep these Allow rules after Disallow to ensure assets can be fetched Allow: /web/assets/ Allow: /web/image/ Allow: /web/content/ Allow: /*.css* Allow: /*.js* Allow: /*.gif* Allow: /*.jpg* Allow: /*.jpeg* Allow: /*.png* Allow: /*.webp* Allow: /*.svg* Allow: /static/ # 6) Sitemap Sitemap: https://www.fleurdecafe.nl/sitemap.xml