What does a search engine spider see at your website?

10th January 2006

Did you ever wonder what pages of your website get “indexed” or “spidered” by a search engine? Improper design can make some of your pages invisible to the search engines.

John Alexander, of Search Engine Workshops brought this Search Engine Spider simulator to my attention in his “SEO tip of the day”.

Just type in your URL, and you’ll get a list of every page the spider can get to. Are some of your pages completely missing? Find out here.


Disclosure:
Some of the links on this website and possibly even in this article may be affiliate links. That does not in any way discount my recommendation, and I do not accept paid reviews. It's simply impossible and unreasonable to mention each possible affiliation individually, so please try to get over it ;-)

Please leave a comment, or use one of these networks for sharing...

  • del.icio.us
  • Sphinn
  • StumbleUpon
  • Digg
  • Google Bookmarks
  • Technorati
  • TwitThis

Other stuff I've written that you might like:

  1. SEO 101 – A proper website foundation for the search engines
  2. Results Based SEO (Search Engine Optimization)
  3. Winning the Search Engine War
  4. How to Use a Search Engine
  5. Search Engine for Sounds


twitter / shendison

This entry was posted on Tuesday, January 10th, 2006 at 5:44 pm
I've filed it filed under SEO, Search Engines.
You can follow any responses to this entry through the RSS 2.0 feed.
If you know how, you can even leave a trackback from your own site, and if it's not spam, I'll leave it.
Pretty nifty, huh? Why are you still reading this?



Leave a Reply
Privacy & Security Policy | Site Map
Portland Graphic Design by Fierce Thought
Copyright 2002 - 2009; Scott Hendison; All Rights Reserved.