Robots.txt is a file that exists on the root Listing of each Web-site and can be utilized to instruct search engines like yahoo on which directories/documents of the web site they are able to crawl and contain inside their index. Increase how your internet site seems to be in Google https://r2bet.com