Steps to Spider Friendly Website

To make a website search engine friendly with less effort is everyone’s wish and dream. Below we have 10 basic steps which would ensure you to crawl your website on the search engines.
Proper Nesting: Many spiders are built to parse the HTML on the page itself. One of the important things to note is that these spiders would confuse a parser or make it work harder with improper nesting of HTML elements on page. So the proper nesting of tags is very important which would allow spiders to easily crawl and see through the website making it SEO friendly.

Use of Frames: Use of frames should be avoided as far as possible. Because the frame is a spider killer. You can’t specifically link to a specific page in a framed site which would lead to linking of page but the rest of the page would disappear. If you link to main page frame there would be no way to link to sub pages. But if one wants to use frame one can make use of I-Frames. I-Frames offer a slightly different advantage as it has its own URL feature which at many times becomes inaccessible.

Search Engine Friendly URL’s: The URL’s one keeps should be search engine friendly which would appeal more to actual URL’s is being used up. Never use id in your URL as Google doesn’t spider up those page and from the beginning itself it would get goofed up.

Proper Meta Tags: Use of proper Meta tags is very important as it will lead to increase up of SERP in Google. Yahoo makes use of description tags and prefers to have sites who use them. The search engine spiders have a natural way to make your website search through your keywords using proper Meta tags and description.

JavaScript/Images/Flash: JavaScript, Images and Flash are things one should try to avoid as making use of it will allow search engine spiders to crawl the website less. The website having flash and other multimedia things would make search engine spiders to crawl the website less as having flashed into websites make them bulky.

Links: The links to your website bring spiders to visit and help you build your rank but links to site are very important. Google limits one to link the page up to 100 links and other search engines links till 150 pages. So the maximum allowable links is 150 for your site.

Keyword Stats and Code: text ratio: One should keep a goal in mind that one should have maximum content possible while limiting the amount of code. There should be a limitation to usage of keyword phrases to minimum as far as possible. If one wants proper meaningful SEO work then one needs to really invest first few dollars on finding the first few keywords which includes various tools like wordtracker.com to give one a start.

Standards Compliant/Accessible: The standard compliant is built on a validator tool which was used by W3c. By making your website standards compliant, one can remove the possible errors in the code which hang up as a spider. This compliance is not critical in parsing error making it ease the process of being spidered.

Branding: The links within the website should always use the same links either www or non www branding. Many search engines see those variants as 2 separate sites and Google will make different PR to a page based on www or non-www. This can be further enforced by changing htaccess file to automatically switch versions if other is visited. If a non www version is visited it will get converted to www version. This is a major enhancement for a lot of work involved.

On thoroughly understanding these 10 steps it will ensure that your site is well received by all of search engine spiders and will limit the bare essentials for only one spider. These 10 steps should be performed at the creation of your website and continue throughout the life-cycle to make spiders able to perform better with as little effort on their part as possible.

Tags: Compliance, Google, Search Engines, Tools


1 user commented in " Steps to Spider Friendly Website "

Follow-up comment rss or Leave a Trackback

MichaNo Gravatar said,
in July 27th, 2009 at 2:26 am

Interesting the structure of the website in such a way is ” if the Spider the connection between words, word cliches and the following sentences; verstehen” = ” analysieren” and from it conclusions to pull can. How then can a Reisewebsite be filled with meaningful contents, which there is already 100xmal in the www?

Leave A Reply

 Name (*required)

 Email Address (*private)

 Website (*optional)