User-agent: * Allow: / # Disallowed Sub Directories Disallow: /extranet/ Disallow: /content/documents Disallow: /content/uploads