Monday, May 26, 2008

Indexing/Crawling Related Questions

  1. How to check whether the page is crawled by search engine or not?
  2. How often the search engine can index/crawl your site?
  3. How the crawler of a site read the data of a page?
  4. Is it possible to index the footer of the page before any other part? Justify your answer.
  5. A domain is not crawled by search engine, how much time you will take to crawl it.
  6. I don't want to crawl some part of page. For example I want that crawler crawl my page, but not index any specific table. How is it possible?

No comments: