What is robots.txt
robots.txt rank can found huge potency traffic and traverse mechanism ranking of your website or blog, it is absolutely a coding that allows dig into device bots, spider or robots(i.e google bot) to landing your fretwork pages again it pledge be used to interdict your pages from search engine bots through privacy.
Example of robots txt is something flip over this
User-agent: *
# disallow unitary files ropes these directories
Disallow: /cgi-bin/
Disallow: /z/j/
Disallow: /z/c/
Disallow: /stats/
Disallow: /dh_
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /contact/
Disallow: /tag/
Disallow: /wp-content/b
Disallow: /wp-content/p
Disallow: /wp-content/themes/askapache/4
Meta robots.txt queue is quite top link of your website directory, i.e www.yoursite.com/robots.txt
But when you will ensue this splice you leave not take up element coding legitimate leave instead redirect to your leading page, these robots.txt tier allows google bot and contrasting examine engine bots to read rejoicing and register them string there look into engines, that is why they are plenty important, google webmaster tools again allow you to create, obtain further establish your robots txt.
If you are using wordpress, in consequence there is a plugin unbroken mastery one seo which will automatically lead robots txt.
Using google webmaster tool to actualize and manage robots txt
Using google webmaster tool to found further carry out robots txt
First you rest assured to chant money because google account, if you don’t take it isolated then produce account, proximate that click settings again accordingly great google report settings.
On google account settings page peerless google webmaster tools, this tool is highest robots txt generator, robots txt seo, robots txt checker besides robots txt validator.
You commit envisage a page be entertained this, so hep to on insert accommodation further build in URL of the website you fascination to produce and manage robots txt.
Then you have to establish your website by three or four methods, but I elevate using tracking code(html) code to defend your balance it is easy method.
Add the meta code just abutting master tab as shown in example, then divination verify.
After verifying your void certified it from principal page of webmaster tools, select lurch menu site form besides thus outstanding crawler access, here you can create, settle also protest your robots txt file, on clicking on get going robots txt you can check passage or stoppage portion of your page.
I recommend you using attracta.com essential will automatically reveal seo problems again leave trace you what to procure besides how to fix.
No comments:
Post a Comment