user-agent: * Allow: /$ Disallow: / User-agent: * Crawl-Delay: 60