Page is blocked for any search indexing according to robots.txt

Rule from seo under content category

What is a trooper!

we have submitted your edit to the community for review! We'll review and make it live on the site in the next few hours, the internet thanks you :).

Browse another section of the knowledge base



Suggest an edit

Cancel

This rule has no content... yet.

Add content to this rule

Or just browse to view rules that have content



 

Your site is using a robots.txt file to block all search engines from indexing it entirely.

How do I fix this ?

Ensure that the robots.txt file is not blocking this page using an * (asterisk).

# Blocks the whole site for all search engines
User-agent: *
Disallow: /

# Blocks all search engines in a specific area
User-agent: *
Disallow: /admin

Caveats

Using robots.txt to hide parts of your site is ineffective. In fact, it makes it easier for malware bots. They may simply download your robots.txt file and purposely access the hidden resources as it is public. There is no way to force bots to obey robots.txt.

Resources

Browse another section of the knowledge base



Signup icon
Ready to see how well your site scores?

Passmarked works best when you have an account. It allows you to keep a dashboard with saved data of the sites you have run through the system, we’ll alert you about important updates and you get access to the Passmarked Slack forum.

Sign up to get started