We Use Shopify as Our Ecommerce Platform

Robots.txt Rules

General Rules for All User-Agents

• User-agent: *
  • Disallow:
    • /a/downloads/-/*
    • /admin
    • /cart
    • /orders
    • /checkouts/
    • /checkout
    • /86940090643/checkouts
    • /86940090643/orders
    • /carts
    • /account
    • /collections/sort_by
    • /*/collections/sort_by
    • /collections/+
    • /collections/%2B
    • /collections/%2b
    • //collections/+*
    • //collections/%2B*
    • //collections/%2b*
    • */collections/filter&filter
    • /blogs/+
    • /blogs/%2B
    • /blogs/%2b
    • //blogs/+*
    • //blogs/%2B*
    • //blogs/%2b*
    • /*?oseid=
    • /preview_theme_id
    • /preview_script_id
    • /policies/
    • /*/policies/
    • //?ls=&ls=*
    • //?ls%3D%3Fls%3D*
    • //?ls%3d%3fls%3d*
    • /search
    • /apple-app-site-association
    • /.well-known/shopify/monorail
    • /cdn/wpm/*.js
    • /recommendations/products
    • /*/recommendations/products
    • /services/login_with_shop
    • /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • //products/-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • /collections//products/-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • //collections//products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • /services/login_with_shop/

Sitemap

• Sitemap: https://www.havaianas.com/sitemap.xml

Specific User-Agent Rules

Google Adsbot

• User-agent: adsbot-google
  • Disallow:
    • /checkouts/
    • /checkout
    • /carts
    • /orders
    • /86940090643/checkouts
    • /86940090643/orders
    • /*?oseid=
    • /preview_theme_id
    • /preview_script_id
    • /cdn/wpm/*.js
    • /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • //products/-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • /collections//products/-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • //collections//products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • /services/login_with_shop

Nutch

• User-agent: Nutch
  • Disallow: /

AhrefsBot

• User-agent: AhrefsBot
  • Crawl-delay: 10
  • Disallow:
    • /a/downloads/-/*
    • /admin
    • /cart
    • /orders
    • /checkouts/
    • /checkout
    • /86940090643/checkouts
    • /86940090643/orders
    • /carts
    • /account
    • /collections/sort_by
    • /*/collections/sort_by
    • /collections/+
    • /collections/%2B
    • /collections/%2b
    • //collections/+*
    • //collections/%2B*
    • //collections/%2b*
    • */collections/filter&filter
    • /blogs/+
    • /blogs/%2B
    • /blogs/%2b
    • //blogs/+*
    • //blogs/%2B*
    • //blogs/%2b*
    • /*?oseid=
    • /preview_theme_id
    • /preview_script_id
    • /policies/
    • /*/policies/
    • //?ls=&ls=*
    • //?ls%3D%3Fls%3D*
    • //?ls%3d%3fls%3d*
    • /search
    • /apple-app-site-association
    • /.well-known/shopify/monorail
    • /cdn/wpm/*.js
    • /services/login_with_shop
    • /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • //products/-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • /collections//products/-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • //collections//products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote
    • Sitemap: https://www.havaianas.com/sitemap.xml

AhrefsSiteAudit

• User-agent: AhrefsSiteAudit
  • Crawl-delay: 10
  • Disallow:
    • [similar disallow rules as above]

MJ12bot

• User-agent: MJ12bot
  • Crawl-delay: 10

Pinterest

• User-agent: Pinterest
  • Crawl-delay: 1