Robots.txt & Meta Noindex, Nofollow Tags

Robots Exclusion Standard

When primitive robots were first created, some of them would crash servers by requesting too many pages too quickly. A robots exclusion standard was crafted to allow you to tell any robot (or all of them) that you do not want some of your pages indexed or that you do not want your links followed.


Full module available to community members.

Learn more about about becoming a member today.



If you already have a premium account please log in using the Log In link at the top of the left column




Considering Joining Our Training Program?

Watch this video to see what you are missing out on.

Improve your rankings, traffic, and profits today. The SEO Book training program offers you:

  • Over 100 training modules, covering topics like: keyword research, link building, site architecture, website monetization, pay per click ads, tracking results, and more.
  • An exclusive interactive community forum
  • Members only videos and tools
  • Additional bonuses - like data spreadsheets, and money saving tips
  • Every order comes risk free, and with the best selling SEO Book as a free bonus