"robot exclusion standard"

1.  Advanced Web Metrics with Google Analytics by Brian Clifton (Paperback - Mar 31, 2008) Buy new: $39.99 $26.39    42 Used & new from $21.43 Get it by Friday, Jan 9 if you order in the next 19 hours and choose one-day shipping. Eligible for FREE Super Saver Shipping.  (17) Excerpt - page 303: "... /offer_codeY This file tells all search engines that obey the robots exclusion standard to not index the files spec- ified. For more information ..." Surprise me! See a random page in this book. Books: See all 88 items

2.  HTTP: The Definitive Guide by David Gourley and Brian Totty (Paperback - Sep 2002) - Illustrated Buy new: $44.95 $29.67    35 Used & new from $25.64 Get it by Friday, Jan 9 if you order in the next 19 hours and choose one-day shipping. Eligible for FREE Super Saver Shipping.  (16) Excerpt - page 229: "... voluntary technique was proposed to keep robots out of where they don't belong and provide webmasters with a mechanism to better control their behavior. The standard was named the "Robots Exclusion Standard" but is often just called robots.txt, after the file ..." Surprise me! See a random page in this book. Books: See all 88 items

3.  Web Services in the Enterprise: Concepts, Standards, Solutions, and Management (Network and Systems Management) by Akhil Sahai and Sven Graupner (Hardcover - May 2, 2005) Buy new: $169.00    21 Used & new from $82.50 Get it by Friday, Jan 9 if you order in the next 19 hours and choose one-day shipping. Eligible for FREE Super Saver Shipping.  (2) Excerpt - page 208: "... within a page), - treatment of request redirection, - resource exclusions (such as images), - reconstruction of visits that span log file boundaries over time, - exclusion of robots and spiders, ..." Surprise me! See a random page in this book. Books: See all 88 items

4.  Pro Drupal Development, Second Edition (Beginning from Novice to Professional) by John K. VanDyk (Paperback - Aug 20, 2008) Buy new:&