SEOENGBot™ and SEOENGWorldBot™ are automated computer programs which safely and politely visit websites, and take a snapshot of the content on those websites. Commonly called "robots", these computer programs are actually run across many servers, and can support crawling millions of websites per day.
If you have access to your website logs, and The SEO Engine™ has crawled your website, you will see signatures similar to this:
[18/Oct/2005:19:45:01 0500] "GET /robots.txt HTTP/1.1" 200 441 "" "Mozilla/5.0 (compatible; SEOENGBot™/1.2; +/seoengbot.htm)"
[11/Oct/2011:12:15:21 0500] "GET /robots.txt HTTP/1.1" 200 441 "" "Mozilla/5.0 (compatible; SEOENGWorldBot™/1.0; +/seoengbot.htm)"
SEOENGBot and SEOENGWorldBot adhere to the "Robots.txt" standard, and will obey every directive. The SEO Engine was essentially built by our community of users, and therefore is one of the most friendly crawlers on the Internet today.
The SEO Engine operates one of the most advanced crawlers on the Internet. Currently, The SEO Engine has two different crawlers:
Google is a registered trademark of Google Inc. SEO Engine is not affiliated with or endorsed by Google Inc.
By using the SEO Engine™ you agree to the Terms of Service (TOS) located at http://www.SEOEngine.com/terms.htm
Copyright © 2014 SEO Engine™ and SEOEngine.com. All rights reserved. U.S. Patent No. 8,447,751. Additional Patents Pending.