- How to optimize your site crawling & Indexing?
-
Your site URLs are like the bridges between your website and a search engine’s crawler: crawlers need to be able to find and cross those bridges (i.e., find and crawl your URLs) in order to get to your site’s content. If your URLs are complicated or repetative, crawlers are going to spend time tracing and retracing their steps; if your URLs are organized and lead directly to distinct content, crawlers can spend their time accessing your content rather than crawling through empty pages, or crawling the same content over and over via different URLs.

Remove user-specific details from URLs.
Remove any URL parameters that change the content of the page—like session IDs or sort order from the URL and put into a cookie.Disallow actions which Googlebot can’t perform.
If you are using your robots.txt file, you can disallow crawling of login pages, contact forms, shopping carts, and other pages whose sole function is to disallow a crawler from indexing.
With one URL, keep one set of content.
In an ideal world, there’s a one-to-one pairing between URL and content: each URL leads to a unique piece of content, and each piece of content can only be accessed via one URL. The closer you can get to this ideal, the more streamlined your site will be for crawling and indexing. If your CMS or current site setup makes this difficult, you can use the rel=canonical element to indicate the preferred URL for a particular piece of content. - Comments: 3 Category: Search Engine Optimization

I only want to tell you thanks for all the great info found on your blog, even helped me with my job recently
keep it up!
Carefully selecting your words and strategically placing them on a page to create impulsive reactions from the reader can lead to a direct sell.
I don’t usually write on blogs but had to on yours. You have a very distinctive writing style. A lot of people don’t have that touch, they just drone on and on in the most boring way. But not you – thanks! Don’t have time to read everything here at the moment, I found your site while looking for something else on Yahoo. But I’ve bookmarked your homepage and will visit it regularly to read your latest postings. I love reading sites about online marketing. It’s such an exciting area. Thanks again for a very informative site!