In a case if your site is hosted on shared server or due to any other reason if you are not allowed to upload the robots.txt file on the site root directory than you can go for the robots meta tag. They work in a similar fashion in which the robots.txt work. The difference is only that, you can specify the meta tags in the HTML file Head section rather than in the seprate file.
<head> <meta name="robots" content="noidex" > </head>
<head> <meta name="robots" content="none" > </head>
Meta robots content value
|index||Include the page in indexing of a site by the crawlers.|
|noidex||Does not include the page in indexing of a site by the crawlers.|
|nofollow||Tell the crawlers not to folllow any links on the page.|
|follow||Allow the crawlers to follow the links on the page.|
|none||Its equivalent to noindex, nofollow. E.g.
<META NAME="robots" CONTENT="none">
|noarchive||Make it sure that Search result page should not show the \\\’cached\\\’ page link from their server.|
|noodp||SERPs should not display page title and description from ODP(Open Directory Project).|
|noyodp||SERPs should not display page title and description from Yahoo Directory(Open Directory Project).|
|nosnippet||description from appearing below the page in the search results, as well as prevents caching of the page.|
if you have multiple content values then, you can use comma to seprate them. Adding spaces to seprate the values does not make any sense.
<head> <meta name="robots" content="noidex,nofollow" > </head>
Submission of sitemap to various search engines is very easy and helps in improving the page rank and indexing on our site in the search engines. We must follow this step to boost up the ranking of our site.
Xml Sitemap contains all the links of the website. It has Url of the page, Last modified date, Change frequency and priority of the every page. Any one can see the sitemap posted on your site.
For improving and increasing the site rank of your web site you must submit your site map to following search engines :
1. Google – Google Webmaster tool
2. Bing or Yahoo – Bing Webmaster tool
Submission of sitemap to these sites is very simple and easy. First you have to create the sitemap for your own website, then you are ready to go for submission.
Submission to GOOGLE
Google is providing the free Google Webmaster tool services for submitting the sitemap to its owm search engine. For this you have to create the free account for Google webmaster or you can use the gmail account details to login to the system. Then from the dashboard you have to select your site and one page will be displayed. On the left hand side of this page in Site Configuration there is one submenu SITEMAPS. Click on this submenu and one page will gets displayed. Now, from here you can Test, Submit your site map to the google. This basically helps in indexing of the webpages, increase in the rank of website.
Submission to Bing (Yahoo)
In 2011 yahoo webmaster account aka Yahoo Site Explorer gets merged with So, When you submit your site map to Bing Webmaster tool. . Bing will manage the submission to yahoo and bing in both the search engines. For this you have to create an account in bing and after that you can login to the Bing Webmaster Center and verify your site and after that you can submit the sitemap to the Search engine.
Submission to Ask.com
Although Ask.com as a search engine doent exist any more. But you can still submit sitemap manually to it. You can add the below link
in the address bar of web browser and press the hit button to submit your sitemap, where DOMAIN = your website name. Now you will see the successful message for submission. For e.g.
by using the above link in the addressbar of the web browser.
You can check the urls of your site indexed in google in the following way
where domain is equal to the name of your site. you just have to enter the url in the address bar for the search in the google and have to press the hit button. For e.g.for the non-www urls you can check in the following way
and you will be able to see all the urls listed for your domain. And for the www urls you have to add the www in the url of your domain. For e.g.
That’s it what i came to know about it. If u have any other information related to it. Please do share it with by adding your comment in the box below.
They helps the user to navigate all the important pages of your site from one page of the site. This will cover all the links which are not discovered by the Crawlers or if the user is unable to find any page by search process on the site.
What is HTML sitemap?
It is a web page on your site which covers all the links on your site. This is basically a structure of the pages on your site. These are created for user friendly website navigation and for the search engines. Eg. of image or any article, post that has been archived on your site.
Importance : This will make browsing the site easy by the user. From the single page on your site user can navigate to all the links available on your site. It is viewed by both the humans and the search engines.
How to create the HTML Sitemap?
You can use plain html as it is used to create the other pages on the site. You can use css styles, html tags like table, tr etc.You can also categorize the links on the basis of products, articles, different categories, or by the archives of the months etc.
You must create the multiple files for if there are 100 links or more than this links are there. Suppose you have 100 or above links but less than 200 links for the html site map than you can create the two html sitemap files to be submitted to google. and in the similar way you can add the more files to your sitemap if there are more than 200 links in your site. and we must intelink these multiple pages with each other. In other way all the sitemap links page must be interlinked to be followed one after another.
E.g. It is a good practice to keep 100 links per page for the html sitemap. and we should update them daily as they got expired as soon as crawlers follow all the links on this sitemap. Will soon add the example for this.
If you have more information related to this article or any suggestion than do correct me by posting your comments in the box below.
For indexing on google you must avoid invalid, broken url’s on your site. You must create the 404 status html page on your site to provide better experience to the user of the site. On this page you can add some useful text rather than “Page not found” message. Following things can be added
1. Search box with the search facility.
2. Link to home page.
3. Link to parent directory of the site.
4. Closest match of the url which the user has typed in the addree bar of the page.
By using the above things you can keep the user on your site rather than he moves to another site.
* Note: you must keep the design of the 404 page similar to the design of the whole site.
What is a Linkback ?
It is a web method which tells the author on the web that who is linking to their blog, document or referring their post in their article. It is a two way linking process. There are three types of it.
What is Interlinking?
Interlinking refers to linking the posts, articles which are available in your own blog. You can link all the articles which are of similar topic or category. For example you can link Sitemaps related article to each other. In the similar way there is a possibility that any SEO article can be linked to any specific category article. In this way we can create the Web for our internal article links, which can help in improving the page ranking of the site. In this we are creating a link between two articles of our blog.
*Try not to include the broken links in your articles.
Will soon add the more information related to linkbacks.
Meanwhike if u have more information about these or any suggestion, then please contact me or provide your comments in the box.
From a command prompt on ubuntu type following commands.
sudo apt-get install apache2
sudo apt-get install php5
sudo apt-get install libapache2-mod-php5
sudo apt-get install mysql-server
If you are running PHP you will also need to install the php module for mysql 5
sudo apt-get install php5-mysql
sudo /etc/init.d/apache2 restart