User-agent: grub-client Disallow: DTS Agent User-agent: grub-client Disallow: / User-Agent: NetResearchServer/2.7(loopimprovements.com/robot.html) Disallow: / User-agent: SlySearch Disallow: / User-agent: Baidu Disallow: / User-agent: baiduspider Disallow: / User-agent: szukacz/1.5 Disallow: / user-agent: szukacz disallow: / User-agent: Linkbot 3.0 Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Harvest Disallow: / User-agent: dumrobo(NaverRobot) Disallow: / User-agent: dloader(NaverRobot) Disallow: / User-agent: Openfind Disallow: / User-agent: psbot Disallow: / User-Agent: sitecheck.internetseer.com Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /graphics/ Disallow: /errordocs/ Disallow: /cgi-bin/ Disallow: /dropship/ Disallow: /images/ Disallow: /Discussion_Forums/ Disallow: /formcontact.html Disallow: /Headline_News/ Disallow: /ubb/ Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.doc$ Disallow: /*.pdf$