User-agent: * Disallow: /intra/ Disallow: /extranet/ Disallow: /cgi-bin/ Disallow: /database/ Disallow: /includes/ Disallow: /badrobot/