## robots.txt ## https://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449 ## Website Sitemap ## Sitemap: https://blasterhub.com/sitemap.xml ## Crawlers Setup ## User-agent: * Crawl-delay: 10 ## Allowable ## Allow: /images/ ## Disllowable ## Disallow: /search/ Disallow: /category/ Disallow: /tag/ Disallow: /author/ Disallow: /review-product/