"robot exclusion protocol"

1.  Robot Colonies by R.C. Arkin and George A. Bekey (Hardcover - Mar 31, 1997) Buy new: $209.00    6 Used & new from $176.00 Get it by Friday, Jan 9 if you order in the next 18 hours and choose one-day shipping. Eligible for FREE Super Saver Shipping. Excerpt - page 9: "... Robots use a mutual exclusion protocol to compete for the right to travel on each path. ..." Surprise me! See a random page in this book. Books: See all 62 items

2.  Introduction to Information Retrieval by Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schütze (Hardcover - Jul 7, 2008) Buy new: $60.00 $48.00    41 Used & new from $25.98 Get it by Friday, Jan 9 if you order in the next 18 hours and choose one-day shipping. Eligible for FREE Super Saver Shipping.  (4) Excerpt - page 408: "... certain portions of their websites off-limits to crawling, under a ROBOTS standard known as the robots exclusion protocol. ..." Surprise me! See a random page in this book. Books: See all 62 items

3.  Google Hacking for Penetration Testers, Volume 2 by Johnny Long (Paperback - Nov 2, 2007) Buy new: $49.95 $32.97    47 Used & new from $29.78 Get it by Friday, Jan 9 if you order in the next 18 hours and choose one-day shipping. Eligible for FREE Super Saver Shipping.  (25) Excerpt - page 518: "... htm A good tutorial on using the robots.txt file. http://googleblog.blogspot.com/2007/02/robots-exclusion-protocol.html Information about Google's Robots policy. ..." Surprise me! See a random page in this book. Books: See all 62 items

4.  SEO: Search Engine Optimization Bible by Jerri L. Ledford (Paperback - Dec 17, 2007) Buy new: $39.99 $26.39    49 Used & new from $18.08 Get it by Friday, Jan 9 if you order in the next 18 hours and choose one-day shipping. Eligible for FREE Super Saver Shipping.