Robots


You will also need to add another meta tag inside the head of your web page. Below is the actual tag and the description of what it does. This meta tag name is called "Robots". Robots are computer programs that scan the internet for websites to index. By default the "Content" value is set to "INDEX" and "FOLLOW". This means that when the website is scanned by the robots, it can be indexed and that the links on the page are followed. If you want the most exposure on the Internet, the default setting should work the best. Also, if this tag is not present at all, by default it is set to "INDEX" and "FOLLOW" automatically. So really, you don't need this tag, but let's say you just want your front page to be indexed and not your sub pages then the settings would be "INDEX" and "NOFOLLOW". You can play around with the robots meta tag to get the setting that is just right for your website.

This metatag will also be placed in the head and will look like this.

<meta name="ROBOTS" content="INDEX, FOLLOW">