# Delay between crawl requests User-agent: * Crawl-Delay: 30 User-agent: * Disallow: /wp-admin/ Disallow: /trackback/ Disallow: /xmlrpc.php Disallow: /feed/ Disallow: /?author=* Disallow: /?s= Disallow: /search/ Allow: /wp-admin/admin-ajax.php