How to Use Robots < META > Tag
If you don’t want some of your pages indexed by google or any other search engine you can use the html <META> tag, it basically tells search bots not to index the content of a web page, it can also tell search bots not to scan the page for links to follow.
The meta tag robots goes inside the <head> tag as shows the example bellow.
<html>
<head>
<title>…</title>
<META NAME=”ROBOTS” CONTENT=”NOINDEX, NOFOLLOW”>
<meta name=”description” content=”" />
</head>
While using robots meta <tag> you should know:
- robots can be bad and ignore your <META> tag. Especially malware robots that scan the web for security holes and spam robots that harvest email addresses to be used by spammers.
- the NOFOLLOW only applies to links on the applied page.
- The NOFOLLOW from robots <meta> tag is not the same as the rel=”nofollow” link attribute.
Valid Values:
NAME=” ROBOTS”.
The “CONTENT” attribute are: “INDEX”, “NOINDEX”, “FOLLOW”, “NOFOLLOW”. All attributes must be separated by commas.
Possible combinations :
<META NAME=”ROBOTS” CONTENT=”NOINDEX, FOLLOW”>
<META NAME=”ROBOTS” CONTENT=”INDEX, NOFOLLOW”>
<META NAME=”ROBOTS” CONTENT=”INDEX, FOLLOW”>
<META NAME=”ROBOTS” CONTENT=”NOINDEX, NOFOLLOW”>
Other attributes can also be added to Robots meta tags, to know more about it please take a look at the post Using Noodp and Noydir
Other Useful related Posts:
- using robots text with Wordpress
- Avoid indexing pages with same content
- using the excerpt re-reloaded plugin
- web building section
You liked this post? feel free to comment on it.