Rule from seo under content category
Passmarked is made out of users just like you who helped supply some content. Click below to contribute to this rule. We need you.Add content to this rule
Your site is using a
robots.txt file to block all search engines from indexing it entirely.
Ensure that the
robots.txt file is not blocking this page using an
# Blocks the whole site for all search engines User-agent: * Disallow: / # Blocks all search engines in a specific area User-agent: * Disallow: /admin
robots.txt to hide parts of your site is ineffective. In fact, it makes it easier for malware bots.
They may simply download your robots.txt file and purposely access the hidden resources as it is public.
There is no way to force bots to obey
Passmarked works best when you have an account. It allows you to keep a dashboard with saved data of the sites you have run through the system, we’ll alert you about important updates and you get access to the Passmarked Slack forum.Sign up to get started