User-agent: * Crawl-Delay: 20 Disallow: /?s=* Disallow: /search/* User-agent: facebookexternalhit Crawl-delay: 30 User-agent: meta-externalagent Crawl-delay: 30 User-agent: SemrushBot Crawl-delay: 60 Sitemap: https://www.upike.edu/sitemap.xml