# All robots will spider the domain User-agent: * Disallow: # Disallow directory /customer/ User-agent: * Disallow: /customer/ # Disallow directory /security/ User-agent: * Disallow: /security/