User-agent: * crawl-delay: 5 Disallow: /wp-json/ Disallow: /selection/ Disallow: /faq-tags/ Disallow: */website/ Disallow: */download/ Disallow: /?post_type=newsletter* Disallow: /search/ Disallow: /es/search/ Disallow: /de/search/ Disallow: /fr/search/ Disallow: /pt-br/search/ Disallow: /ja/search/ Disallow: /ru/search/ Disallow: /zh-hans/search/ Disallow: /it/search/ Disallow: /he/search/ Disallow: /ar/search/ Disallow: *?s=* Disallow: /wp-admin/admin-ajax.php?action=icl_mpp_search Disallow: /checkout* User-agent: BLEXBot Disallow: / User-agent: Cliqzbot Disallow: / User-agent: Baiduspider Disallow: / User-agent: dotbot Disallow: / User-agent: BUbiNG Disallow: / User-agent: voltron Disallow: / User-agent: AhrefsBot Crawl-Delay: 8 User-agent: Yandex Disallow: / User-agent: SeznamBot Request-rate: 10/1m