User-agent: googlebot User-agent: google Disallow: /shops/captcha.php Disallow: /item-pictures/ Disallow: /search/apiSphinx.php User-agent: bingbot User-agent: bing Disallow: /shops/captcha.php Disallow: /item-pictures/ Disallow: /search/apiSphinx.php User-agent: BLEXBot User-agent: ICC-Crawler User-agent: fr-crawler User-agent: CCBot User-agent: OrangeBot User-agent: memoryBot User-agent: itsbetter-bot User-agent: Insitesbot User-agent: 360Spider User-agent: DotBot User-agent: AhrefsBot User-agent: SEOkicks User-agent: SemrushBot User-agent: ltx71 User-agent: MJ12bot User-agent: MegaIndex.ru User-agent: trovitBot User-agent: grapeshot User-agent: adscanner User-agent: LinkWalker User-agent: MauiBot User-agent: MTRobot User-agent: SMTBot User-agent: DataForSeoBot User-agent: serpstatbot User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: AwarioBot User-agent: FriendlyCrawler User-agent: panscient.com User-agent: AliyunSecBot Disallow: / User-agent: * Disallow: /shops/captcha.php Disallow: /item-pictures/ Disallow: /Admin/ Disallow: /search/apiSphinx.php Disallow: /*?*selectshop=* Disallow: /*?*yearstart=* Disallow: /*?*yearend=* Disallow: /*?*pricemin=* Disallow: /*?*pricemax=* Disallow: /*?*sortby=* Disallow: /*?*gallery=1* Disallow: /*?*gallery=2* Disallow: /*?*certification=* Disallow: /*user.php?* # AI training: limited for a start - no filter combinations and no free-text # search results, slowed down. A named group replaces "*" completely, so the # rules above are repeated here. User-agent: GPTBot User-agent: ClaudeBot Crawl-delay: 1 Disallow: /shops/captcha.php Disallow: /item-pictures/ Disallow: /Admin/ Disallow: /*?*selectshop=* Disallow: /*?*yearstart=* Disallow: /*?*yearend=* Disallow: /*?*pricemin=* Disallow: /*?*pricemax=* Disallow: /*?*sortby=* Disallow: /*?*gallery=1* Disallow: /*?*gallery=2* Disallow: /*?*certification=* Disallow: /*user.php?* Disallow: /*search.php Disallow: /search/