User-agent: * Disallow: /includes Disallow: /userFiles Disallow: /adminArea.php Disallow: /admin Disallow: /member_area* Disallow: /login* Disallow: /blackhole Disallow: *cal* Disallow: *directory* Disallow: *group* Disallow: *prayer* Crawl-delay: 5 Request-rate: 1/5 Visit-time: 0400-0900 User-agent: Baiduspider Disallow: / User-agent: Yandex Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: MJ12bot/v1.4.5 Disallow: / User-agent: MJ12bot/v1.4.0 Disallow: / User-agent: MJ12bot/v1.2.4 Disallow: / User-agent: MJ12bot/v1.2.3 Disallow: / User-agent: MJ12bot/v1.0.8 Disallow: / User-agent: MJ12bot/v1.0.7 Disallow: / User-agent: MJ12bot/v1.0.6 Disallow: / User-agent: MJ12bot/v1.0.5 Disallow: / User-agent: SurveyBot Disallow: / User-agent: WebsiteWiki Disallow: / User-agent: ShopWiki Disallow: / User-agent: Jakarta Commons-HttpClient Disallow: / User-Agent: AboutUsBot Disallow: /