Yip, that’s really a thing. Your website might be telling Google to ignore your business, products and services. It could be telling Google to look elsewhere, directly at your competitors. Yikes.

There is a time and a place for this setting, but it’s certainly not if you’re looking to improve your SEO and build your business. And if you are, this setting is holding you back. Here’s a quick test to see if your website is pushing new customers and sales away.

Test if your website is blocking Google

  1. Go to
  2. Paste your full website URL, like
  3. Press Enter
  4. Do you see “A description for this result is not available because of the site’s robots.txt – Learn more”?

What to do if your robots.txt file is blocking Google

If your search results reference your websites robots.txt file, contact your web developer immediately. You can say “My robots.txt file is blocking my website from Google. Please can it be amended immediately.

Why was your website blocked from Google in the first place?

When web developers create new websites, they will often block them from Google. This is purposefully done to avoid Google referencing a website that is incomplete, or one that is not ready for the public. When the website is put live however, this setting should be removed.

How do you stop your website from being indexed by Google?

This is usually set up by an experienced web developer, in the robots.txt file, but depending on your CMS and hosting environment, there are other ways to achieve this too. They can check your HTACCESS file, and if you’re using WordPress and Yoast for example, you can check your WordPress > Settings > Reading > Search engine visibility to untick Discourage search engines from indexing this site too.

Do you need help?

It’s important to note that blocking websites, pages or directories from Google can send them the wrong type of signal. These settings are best left to an SEO expert, and applied by a website developer.

Either way, with the right access and knowledge, this is a quick fix. Please contact us if your website is being blocked by Google unintentionally, and you need a hand.

Subscribe for more helpful articles.

If you found this useful, you can get our latest ideas delivered directly to your inbox, for free, by subscribing below.