Wednesday, May 18, 2011

The Deep Web

The Deep Web or Invisible Web are untapped resources that are not typically indexed by search engines. Elements of the invisible web are:
  • unindexed pages
  • electronic books
  • product catalogs
  • library catalogs
  • online newsletters
  • government records and 
  • other databases

Typically information must be accessed directly from a specialized search engine within the resource. 

Crawling and indexing are processes which can take some time and which rely on many factors. In general, we cannot make predictions or guarantees about when or if your URLs will be crawled or indexed.

Google Webmaster Central. http://www.google.com/support/forum/p/Webmasters/thread?tid=559f12c1e8e243cf&hl=en (Nov 11, 2011)