User-agent: ia_archiver Disallow: / User-agent: sogou spider Disallow: / User-agent: spbot Disallow: / User-agent: SemrushBot Disallow: / User-agent: sentibot Disallow: / User-agent : DAUM Disallow : / User-agent: dotbot Disallow: / User-agent: ahrefsbot Disallow: / User-agent: MauiBot Disallow:/ User-agent: MauiBot (crawler.feedback+wc@gmail.com) Disallow: / User-agent: mj12bot Disallow: / User-agent: mojeekbot Disallow: / User-agent: shareaholicbot Disallow: / User-agent: baiduspider Disallow: / User-agent: blexbot Disallow: / User-agent: BUbiNG Disallow: / User-Agent: trendictionbot Disallow: / User-agent: Seekport Crawler Disallow: / ## END Custom made User-agent: * Disallow: /ajax/ Disallow: /click/ Disallow: /generators/ Disallow: /cron/ Disallow: /dodaj/ Disallow: /konto/ Disallow: /tmp/ Disallow: /szukaj Disallow: /*.php Sitemap: https://lol24.com/sitemaps.xml