User-agent: * Disallow: /inc/ Disallow: /includes/ Disallow: /sitemap-generator/ Disallow: /CSV/ Disallow: /media/ Disallow: /javascript/ Disallow: /ntunnel_mysql.php User-agent: googlebot Disallow: *.csi Sitemap: