Indiabloggerbuzz

Facebook follower

How to Add Custom Robot.txt in blogger



Add Custom robot.txt in blogger

In one of my Previous Post I have discussed about blogger basic settings .today I tell you blogger more and importantsettings for SEO. This Post about Custom Robot.txt file which is most important for blog Search Ranking, Custom Robot.txt means now you can customize this robot file according to your choice. In today’s tutorial I will discuss about Custom Robot.txt in deep and come to know about it’s use and benefits. I will also tell you how to add custom Robot.txt in blogger. So let start the tutorial.

What is Custom Robot.txt   

Custom Robot.txt is a text file which contain a few simple code.Custom robot.txt is saved on the blog’s  or website server which is instruct the web crawlers, how to index and crawl your blog in the search engine.That means web crawlers index your content by following your instruction in the robot.txt. by customization of robot.txt you can restrict any web page on your blog from web crawlers so that it can’t get indexed in search engines like your blog labels page, your demo page or any other pages that are not as important to get indexed.



Important note:search crawlers scan the robots.txt file before crawling any web page

Follow the below instruction and image to setup custom robot.txt in blogger blog
  •   Go to Blogger dashboard >>Settings>>Choose Search Preference>>Click Edit in custome robot.txt below the Crawlers and Indexing>> Select Yes to Enable custom robots.txt and Copy below coding: 


User-agent: Mediapartners-Google

Disallow:

User-agent: *

Disallow:/search

Allow:/

Sitemap:http:// YOUR-BLOG-URL /feeds/posts/default?orderby=UPDATED



Note : this sitemap will only tell the web crawlers about the recent 25 posts. If you want to increase the number of link in your sitemap then replace default sitemap with below one. It will work for first 500 recent posts.

Sitemap: http://example.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500


 >>Paste the copy code in Custom robots txt box and click on>> Save changes button

How to setup blogger robot.txt for better SEO


Get More Useful Related Post

How To Add Blogger Basic Settings
How to change/Adjusting comment and post Settings with blogger blog - See more at: http://www.indiabloggerbuzz.blogspot.in/2013/08/how-to-changeadjusting-comment-settings.html#m


You are done!This robot.txt tutorial is complete if you have any doubt and query then feel free to ask me. just put the comment form below.Happy Blogging!

Reactions:

0 comments:

Post a Comment

Chandan Sharma – Mainstream blogger who brings out all the hottest news, tips and strategies about blogging, social media and SEO.Chandan Sharma can help you and specially new comers in Web Development, Make Money, Seo and Online Marketing Money and So on...