robots.txt
Shopify Plus Store - Enhanced E-commerce Protection
Robots & Agent Policy - Shopify Plus
Checkouts are for humans only.
- Automated scraping, "buy-for-me" agents, or any end-to-end flow that completes payment without human review is prohibited.
- Legitimate integrators must use official Shopify APIs
- Checkout Kit: https://www.shopify.com/checkout-kit
Terms of Service: https://warmies.com/policies/terms-of-service
Contact: legal@warmies.com
SHOPIFY PLUS CORE PROTECTION
User-agent: *
Critical e-commerce endpoints
Disallow: /admin
Disallow: /cart
Disallow: /carts
Disallow: /orders
Disallow: /checkouts/
Disallow: /checkout
Disallow: /account
Disallow: /28406808664/checkouts
Disallow: /28406808664/orders
Shopify Plus specific paths
Disallow: /a/downloads/-/*
Disallow: /apps/subscriptions/manage/
Disallow: /services/login_with_shop/authorize
Disallow: /private_access_tokens
Disallow: /sf_private_access_tokens
Product and collection filtering (performance optimization)
Disallow: /collections/sort_by
Disallow: //collections/sort_by
Disallow: /collections/+*
Disallow: /collections/%2B
Disallow: /collections/%2b
Disallow: //collections/+*
Disallow: //collections/%2B*
Disallow: //collections/%2b*
Disallow: //collections/filter&filter
Disallow: /collections//products/
Blog filtering
Disallow: /blogs/+
Disallow: /blogs/%2B
Disallow: /blogs/%2b
Disallow: //blogs/+*
Disallow: //blogs/%2B*
Disallow: //blogs/%2b*
Shopify system paths
Disallow: /?oseid=
Disallow: /preview_theme_id
Disallow: /preview_script_id
Disallow: /.well-known/shopify/monorail
Disallow: /cdn/wpm/.js
Disallow: /recommendations/products
Disallow: /*/recommendations/products
Third-party integrations + feeds
Disallow: _rdiscovery-widget
Disallow: rdiscovery
Disallow: /*.atom
URL parameter optimization
Disallow: //?ls=&ls=*
Disallow: //?ls%3D%3Fls%3D*
Disallow: //?ls%3d%3fls%3d*
Disallow: /?page=
Disallow: /&page=*
Disallow: /srsltid=
Disallow: /t_blank
Disallow: /?page=*
Dynamic cart operations
Disallow: /cart/change/*
Disallow: /cart/add*
Disallow: /cart/update*
Mobile and system files
Disallow: /apple-app-site-association
Disallow: /assets/
Allow important pages for SEO and trust
Allow: /policies/
Allow: /pages/
SHOPIFY PLUS: Enhanced crawl budget management
Crawl-delay: 1
Sitemap: https://warmies.com/sitemap.xml
GOOGLE ADS BOT (requires explicit rules)
User-agent: adsbot-google
Disallow: /checkouts/
Disallow: /checkout
Disallow: /carts
Disallow: /cart
Disallow: /orders
Disallow: /28406808664/checkouts
Disallow: /28406808664/orders
Disallow: /account
Disallow: /?oseid=
Disallow: /preview_theme_id
Disallow: /preview_script_id
Disallow: /cdn/wpm/.js
MOBILE GOOGLEBOT
User-agent: Googlebot-Mobile
Inherits from main * rules
SEO TOOLS - CONTROLLED ACCESS
User-agent: AhrefsBot
Crawl-delay: 15
Disallow: /admin
Disallow: /cart
Disallow: /carts
Disallow: /orders
Disallow: /checkouts/
Disallow: /checkout
Disallow: /account
Disallow: /28406808664/checkouts
Disallow: /28406808664/orders
Disallow: /collections/sort_by
Disallow: //collections/sort_by
Disallow: /collections/filter&filter
Disallow: /?oseid=
Disallow: /preview_theme_id
Disallow: /preview_script_id
Disallow: /.well-known/shopify/monorail
Disallow: /cdn/wpm/*.js
User-agent: AhrefsSiteAudit
Crawl-delay: 15
Disallow: /admin
Disallow: /cart
Disallow: /carts
Disallow: /orders
Disallow: /checkouts/
Disallow: /checkout
Disallow: /account
Disallow: /28406808664/checkouts
Disallow: /28406808664/orders
Disallow: /collections/sort_by
Disallow: //collections/sort_by
Disallow: /collections/filter&filter
Disallow: /?oseid=
Disallow: /preview_theme_id
Disallow: /preview_script_id
Disallow: /.well-known/shopify/monorail
Disallow: /cdn/wpm/*.js
User-agent: SemrushBot
Crawl-delay: 20
Disallow: /admin
Disallow: /checkouts/
Disallow: /checkout
Disallow: /cart
Disallow: /account
User-agent: MJ12bot
Crawl-delay: 15
User-agent: Pinterest
Crawl-delay: 2
BLOCK AGGRESSIVE CRAWLERS
User-agent: Nutch
Disallow: /
User-agent: DataForSeoBot
Crawl-delay: 30
Disallow: /admin
Disallow: /checkouts/
Disallow: /cart
Disallow: /account
AI TRAINING & DATA COLLECTION BOTS - COMPLETE BLOCK
User-agent: AI2Bot
User-agent: Ai2Bot-Dolma
User-agent: Amazonbot
User-agent: Applebot-Extended
User-agent: Baiduspider
User-agent: Bytespider
User-agent: CCBot
User-agent: ChatGPT-User
User-agent: Claude-Web
User-agent: ClaudeBot
User-agent: Diffbot
User-agent: FacebookBot
User-agent: FriendlyCrawler
User-agent: GPTBot
User-agent: Google-Extended
User-agent: GoogleOther
User-agent: ICC-Crawler
User-agent: ImagesiftBot
User-agent: MauiBot
User-agent: Meta-ExternalAgent
User-agent: Meta-ExternalFetcher
User-agent: OAI-SearchBot
User-agent: PerplexityBot
User-agent: PetalBot
User-agent: Timpibot
User-agent: VelenPublicWebCrawler
User-agent: Webzio-Extended
User-agent: YandexBot
User-agent: YouBot
User-agent: anthropic-ai
User-agent: cohere-ai
User-agent: facebookexternalhit
User-agent: iaskspider/2.0
User-agent: img2dataset
User-agent: omgili
User-agent: omgilibot
Crawl-delay: 10
User-agent: PowerMapper
Disallow: /blogs/*
Disallow: /apps/*
Disallow: /pages/affiliate-program
Disallow: /pages/become-a-warmies-ambassador-form