#Live ROBOTS File v20200616 #Bots #Applies to Google User-Agent: Googlebot Allow: .js Allow: .css #Applies to all bots User-agent: * #Block system pages Disallow: /thank-you/ Disallow: /site-map-search/ Disallow: /special/ Disallow: /x-files/ Disallow: /wp-json/ #Block all word press admin pages Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php #Block all pages from blog tool Disallow: */author/ Disallow: */tag/ Disallow: */feed/ #Block specific pages Disallow: /home-video-feature-mobile/