User-agent: * Disallow: # disallow alexa crawler User-agent: ia_archiver Disallow: /