User-agent: * Disallow: /clients/ Disallow: /assets/ Disallow: /constantcontact/ Disallow: /demos/ Disallow: /history/ Disallow: /images/ Disallow: /iphone/ Disallow: /META-INF/ Disallow: /old/ Disallow: /qa/ Disallow: /scripts/ Disallow: /styles/ Disallow: /textures/ Disallow: /videos/ Disallow: /WEB-INF/ # Disallow everything - goes with the Allow command that follows Disallow: / # Allow only index.html and index.php Allow: /index.php Allow: /index.html