Use of Frames: Use of frames should be avoided as far as possible. Because the frame is a spider killer. You can’t specifically link to a specific page in a framed site which would lead to linking of page but the rest of the page would disappear. If you link to main page frame there would be no way to link to sub pages. But if one wants to use frame one can make use of I-Frames. I-Frames offer a slightly different advantage as it has its own URL feature which at many times becomes inaccessible.
Search Engine Friendly URL’s: The URL’s one keeps should be search engine friendly which would appeal more to actual URL’s is being used up. Never use id in your URL as Google doesn’t spider up those page and from the beginning itself it would get goofed up.
Proper Meta Tags: Use of proper Meta tags is very important as it will lead to increase up of SERP in Google. Yahoo makes use of description tags and prefers to have sites who use them. The search engine spiders have a natural way to make your website search through your keywords using proper Meta tags and description.
JavaScript/Images/Flash: JavaScript, Images and Flash are things one should try to avoid as making use of it will allow search engine spiders to crawl the website less. The website having flash and other multimedia things would make search engine spiders to crawl the website less as having flashed into websites make them bulky.
Links: The links to your website bring spiders to visit and help you build your rank but links to site are very important. Google limits one to link the page up to 100 links and other search engines links till 150 pages. So the maximum allowable links is 150 for your site.
Keyword Stats and Code: text ratio: One should keep a goal in mind that one should have maximum content possible while limiting the amount of code. There should be a limitation to usage of keyword phrases to minimum as far as possible. If one wants proper meaningful SEO work then one needs to really invest first few dollars on finding the first few keywords which includes various tools like wordtracker.com to give one a start.
Standards Compliant/Accessible: The standard compliant is built on a validator tool which was used by W3c. By making your website standards compliant, one can remove the possible errors in the code which hang up as a spider. This compliance is not critical in parsing error making it ease the process of being spidered.
Branding: The links within the website should always use the same links either www or non www branding. Many search engines see those variants as 2 separate sites and Google will make different PR to a page based on www or non-www. This can be further enforced by changing htaccess file to automatically switch versions if other is visited. If a non www version is visited it will get converted to www version. This is a major enhancement for a lot of work involved.
On thoroughly understanding these 10 steps it will ensure that your site is well received by all of search engine spiders and will limit the bare essentials for only one spider. These 10 steps should be performed at the creation of your website and continue throughout the life-cycle to make spiders able to perform better with as little effort on their part as possible.








1 user commented in " Steps to Spider Friendly Website "
Follow-up comment rss or Leave a TrackbackInteresting the structure of the website in such a way is ” if the Spider the connection between words, word cliches and the following sentences; verstehen” = ” analysieren” and from it conclusions to pull can. How then can a Reisewebsite be filled with meaningful contents, which there is already 100xmal in the www?
Leave A Reply