User-agent: 360Spider Disallow: / User-agent: 8LEGS Disallow: / User-agent: AhrefsBot Disallow: / User-agent: betaBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: BoardReader Disallow: / User-agent: BPImageWalker Disallow: / User-agent: CheckMarkNetwork Disallow: / User-agent: Clockwork Data Vault Disallow: / User-agent: coccoc Disallow: / User-agent: CRAZYWEBCRAWLER Disallow: / User-agent: Domain Re-Animator Disallow: / User-agent: DomainStatsBot Disallow: / User-agent: DotBot Disallow: / User-agent: EasouSpider Disallow: / # Ezooms and dotbot User-agent: Ezooms Disallow: / User-agent: Findxbot Disallow: / User-agent: GetIntent Disallow: / User-agent: Grammarly Disallow: / User-agent: Guardcrwlr Disallow: / User-agent: HubSpot Links Crawler Disallow: / User-agent: istellabot Disallow: / User-agent: KOCMOHABT Disallow: / User-agent: link checker Disallow: / User-agent: linkcheck Disallow: / User-agent: LinksCrawler Disallow: / User-agent: linkdexbot Disallow: / User-agent: Link Sleuth Disallow: / User-agent: LinkSpammer Disallow: / User-agent: LinkWalker Disallow: / User-agent: ltx71 Disallow: / User-agent: Mail.RU_Bot Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: NetTrack Disallow: / User-agent: okhttp Disallow: / User-agent: OpenLinkProfiler Disallow: / User-Agent: PaperLiBot Disallow: / User-agent: Pingdom Disallow: / User-agent: proximic Disallow: / User-agent: Pu_iN Disallow: / User-agent: Pulsepoint Disallow: / User-agent: Qwantify Disallow: / User-agent: RankvalBot Disallow: / User-agent: SalesIntelligent Disallow: / User-agent: Scrapy Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: Searchie Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: SocialRankIOBot Disallow: / User-agent: Sogou Disallow: / User-agent: Sogou web spider Disallow: / User-agent: spbot Disallow: / User-agent: SurveyBot Disallow: / User-agent: Uptimebot Disallow: / User-agent: Vegi bot Disallow: / User-agent: VeriCiteCrawler Disallow: / User-agent: webmeup-crawler Disallow: / User-agent: weborama-fetcher Disallow: / User-agent: YisouSpider Disallow: / User-agent: YoudaoBot Disallow: / # Google Image User-agent: Googlebot-Image Disallow: / # Google AdSense User-agent: Mediapartners-Google* Disallow: # digg mirror User-agent: duggmirror Disallow: / ##PetalBot User-agent: PetalBot Disallow: / # global User-agent: * Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/cache/ Disallow: /wp-content/uploads/ Disallow: /trackback/ Disallow: /feed/ Disallow: /comments/ Disallow: /landing/ Disallow: /preregister/ Disallow: /login/ Disallow: /member/ User-agent: Yandex Disallow: / Crawl-delay: 4 User-agent: bingbot Crawl-delay: 2 User-agent: * Crawl-delay: 30