Show Me How A Search Engine Views My Site:  
System Overview Googlebot vs. SEOENGBot
SEOENGBot

Googlebot vs. SEOENGBot

SEOENGBot™ and SEOENGWorldBot™ are automated computer programs which safely visit Websites and take a snapshot of the content on those Websites. Commonly called "robots", these computer programs are actually run across many servers, and can support crawling millions of Websites per day.

If you have access to your Website logs, and The SEO Engine™ has crawled your Website, you will see signatures similar to this:

[18/Oct/2005:19:45:01 0500] "GET /robots.txt HTTP/1.1" 200 441 "" "Mozilla/5.0 (compatible; SEOENGBot™/1.2; +/seoengbot.htm)"
[11/Oct/2011:12:15:21 0500] "GET /robots.txt HTTP/1.1" 200 441 "" "Mozilla/5.0 (compatible; SEOENGWorldBot™/1.0; +/seoengbot.htm)"

SEOENGBot and SEOENGWorldBot adhere to the "Robots.txt" standard, and will obey every directive. The SEO Engine was essentially built by our community of users, and therefore is one of the most friendly crawlers on the Internet today.

Cutting Edge Technology

The SEO Engine operates one of the most advanced crawlers on the Internet. Currently, The SEO Engine has two different crawlers:

  • SEOENGBot — This "on-demand" crawler runs when a user requests fresh data in the "On-Page" section of the Search Engine.
  • SEOENGWorldBot — This crawler is similar to "Googlebot". It is responsible for the majority of the crawling that the SEO Engine does, and is one of the most advanced pieces of software that is distributed geographically among many computers.

Additional Information: