# Exclude Files From All Robots: User-agent: * Disallow: /clientsector Disallow: /intranet Disallow: /extranet Disallow: /drop Disallow: /admin # End robots.txt file