User-agent:* Disallow: /cgi-bin/ Disallow: /inc/ User-agent: psbot Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Offline Explorer Disallow: / User-agent: linkwalker Disallow: / User-agent: spidersoft Disallow: / User-agent: linksmanager Disallow: / User-agent: pavuk Disallow: /