User-agent: * Disallow: /ar # Allow all crawlers User-agent: * Allow: /