User-agent: * Disallow: /sitedirect/ Disallow: /Scripts/ Disallow: /includes/ Disallow: /flash/ Disallow: /files/ Disallow: /css/