Uncategorized How to avoid Google to crawl a website By Infrarchitect 8 Feb, 2019 Leave a comment Add a robots.txt file at the root directory with the following content. User-agent: * Disallow: / Share this:Click to share on Twitter (Opens in new window)Click to share on LinkedIn (Opens in new window)Click to share on Facebook (Opens in new window) Related Infrarchitect