When primitive robots were first created, some of them would crash servers by requesting too many pages too quickly. A robots exclusion standard was crafted to allow you to tell any robot (or all of them) that you do not want some of your pages indexed or that you do not want your links followed.
If you already have a premium account please log in using the Log In link at the top of the left column
Considering Joining Our Training Program?
Watch this video to see what you are missing out on.
Improve your rankings, traffic, and profits today. The SEO Book training program offers you:
Over 100 training modules, covering topics like: keyword research, link building, site architecture, website monetization, pay per click ads, tracking results, and more.
An exclusive interactive community forum
Members only videos and tools
Additional bonuses - like data spreadsheets, and money saving tips
Every order comes risk free, and with the best selling SEO Book as a free bonus