User-agent: archive.org_bot User-agent: bingbot User-agent: DuckDuckBot User-agent: Googlebot User-agent: Googlebot-Mobile User-agent: ia_archiver User-agent: Yandex Allow: /$ Allow: /?page= Allow: /browse.php Allow: /top.php Allow: /novinki.php Allow: /personsearch.php Allow: /groupexlist.php Allow: /details.php?id= Allow: /persons.php?s= Allow: /groupex.php?id= Allow: /i/poster/ Disallow: / User-agent: Adsbot-Google User-agent: AhrefsBot User-agent: Googlebot-Image User-agent: Mail.Ru User-agent: Mediapartners-Google User-agent: msnbot User-agent: msnbot-media User-agent: Slurp User-agent: StackRambler User-agent: Yahoo-MMCrawler Disallow: / User-agent: * Disallow: /