Tuesday, 18 October 2016

How to setup Custom Robots.txt

Custom Robots.txt

Today We Tell You How to setup Custom Robots.txt and ?,How to create sitemap for blogger?,What is the custom robot.txt and what is doing work regard?,Otherwise, we tell you Why important Robots,txt For SEO?
Any Website or Blog creating fro webmaster the google search engine or other search engine can index these blogs or websites  web pages URL,So google search engine save the best contents web pages and lots best search engine like Google Bing Yahoo etc sent there spider or crawler if these or from the  google you can say that Googlebot,Whenever they see the best blog or site the search engine was enrolling it and they find new web pages and sites ,Robots .txt can use in for any briefing are stop them,

Robots,txt file

This is a text file you are made it easy  on  your note pad and upload this file on your website,If you are work on a blogger the blogger also have robot.txt,Use following codes to activate robots,txt on blogger

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://MySite.blogspot.com/feeds/posts/default?orderby=UPDATED

These codes have been Includes three parts,Let's see the Description of these codes

1 ;User-agent: Mediapartners-Google

This code is use for google  AdSense robot to get best ads for your blog or website

2 ;User-agent*

This code is very imperative for SEO,This code working for only google search engine,If you hang on ahead  (*) on User-agent its mean all search engine like google yahoo bing and many other  search engines index you website web pages

Disallow

This code is make out your authorization to index web pages and materials of your website,
If you wish to your web page or post  nothing index any search engine So you can copy your web page URL and past ahead of code

Example= Disallow:http://www.yoursite.com/custom-robots-txt.html

Then your page not index any search engine

3;Sitemap

http://MyWebSite.blogspot.com/feeds/posts/default?orderby=UPDATED

Sitemap also submits on google webmaster or search console  conventionally,No Problem if you summited here 
NOTE;  Sitemap is working until 500 posts of your site or blog, After all, you submit new sitemap for your blog or website

creates the sitemap on blogger

create the sitemap from 
sitemap generator  for your website

it is free sitemap generator  for your website or blogger


sitemap on blogger





0 comments: