The Meta Robots attribute, or
Robots Meta tag, is used to provide search engines with instructions on how web
pages should be crawled, indexed, and presented in search results.
Example meta
tag robotsAdd the following Meta tag in the HTML source of your page:
<Meta name="robots" content="index, follow">
• The spider
will now index your whole website.
• The spider
will not only index the first webpage of your website but also all your other
WebPages.
You are also allowed to type it like this:
<meta
name="robots" content="INDEX, FOLLOW">
<META
NAME="robots" CONTENT="INDEX, FOLLOW">
<META
NAME="robots" CONTENT="index follow">
By changing the index to no-index and the follow to no-follow
your are able to influence the behavior of the spider. If you don't want the
search engine spider to crawl through your whole website you use the following
meta tag :
<Meta name="robots" content="index,
nofollow">
• The spider
will now only look at this page and stops there.
<Meta name="robots" content="noindex,
follow">
• The spider
will not look at this page but will crawl through the rest of the pages on your
website.
<Meta name="robots" content="noindex,
nofollow">
• The spider
will not look at this page and will NOT crawl through the rest of your
WebPages.
This metatag can also be typed with the / in the end of the tag:
<meta name="robots"
content="index, nofollow" />
<meta
name="robots" content="noindex, follow" />
<meta
name="robots" content="noindex, nofollow" />
----------------*******---------*********-------------***********--------------
No comments:
Post a Comment