If you don’t want some of your pages indexed by google or any other search engine you can use the html <META> tag, it basically tells search bots not to index the content of a web page, it can also tell search bots not to scan the page for links to follow.
The meta tag robots goes inside the <head> tag as shows the example bellow.
<html>
<head>
<title>…</title>
<META NAME=”ROBOTS” CONTENT=”NOINDEX, NOFOLLOW”>
<meta name=”description” content=”" />
</head>
While using robots meta <tag> you should know:
- robots can be bad and ignore your <META> tag. Especially malware robots that scan the web for security holes and spam robots that harvest email addresses to be used by spammers.
- the NOFOLLOW only applies to links on the applied page.
- The NOFOLLOW from robots <meta> tag is not the same as the rel=”nofollow” link attribute.
Valid Values:
NAME=” ROBOTS”.
The “CONTENT” attribute are: “INDEX”, “NOINDEX”, “FOLLOW”, “NOFOLLOW”. All attributes must be separated by commas.
Possible combinations :
<META NAME=”ROBOTS” CONTENT=”NOINDEX, FOLLOW”>
<META NAME=”ROBOTS” CONTENT=”INDEX, NOFOLLOW”>
<META NAME=”ROBOTS” CONTENT=”INDEX, FOLLOW”>
<META NAME=”ROBOTS” CONTENT=”NOINDEX, NOFOLLOW”>
Other attributes can also be added to Robots meta tags, to know more about it please take a look at the post Using Noodp and Noydir
Other Useful related Posts:
You liked this post? feel free to comment on it.
admin Web Building Array, Attributes, Combinations, Comma Separated Values, Email Addresses, Excerpt, Google, Html Meta, Html Tag, Leaves, Lt, Meta Content, Meta Description, Meta Name, Meta Tag, Meta Tags, Nofollow, Noodp, Nutshell, Other Search Engine, Page Don, Rel Nofollow, Robot, robots, Search Bots, Security Holes, Security Vulnerabilities, Spam Email, Spam Robots, Valid Values, Web Building, Web Page