Sitemap: http://www.software112.com/sitemap.xml User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / # # Sorry, wget in its recursive mode is a frequent problem. # Please read the man page and use it properly; there is a # --wait option you can use to set the delay between hits, # for instance. # User-agent: wget Disallow: / # # The 'grub' distributed client has been *very* poorly behaved. # User-agent: grub-client Disallow: / # # Doesn't follow robots.txt anyway, but... # User-agent: k2spider Disallow: / User-agent: * #Allow: /*search-program/1/* #Allow: /*search-program/2/* #Allow: /*search-program/3/* #Allow: /*search-program/4/* #Disallow: /*search-program/* Disallow: /*categories*? Disallow: /*user.php* Disallow: /*user-comments.php* Disallow: /*developers*? Disallow: /*write-comment.html Disallow: /*write-review.html Disallow: /*user-comments.php Disallow: /*+publisher.html Disallow: /list-view*? User-agent: Mediapartners-Google Allow: /