Monthly Archives: February 2019

How to avoid Google to crawl a website

Posted by on 2019-02-08 No comments

Add a robots.txt file at the root directory with the following content.

User-agent: * 
Disallow: /