| |
| |
|
Category
Any Category
|
| |
|
Any Shipping Option
|
|
|
|
| |
|
"robot exclusion standard"
| | | | | Select Results from All Departments |
| | |
|
|
| 2. |
|
|
HTTP: The Definitive Guide
by David Gourley and Brian Totty
(Paperback - Sep 2002) - Illustrated |
| Buy new: $44.95 $29.67
35 Used & new
from $25.64 |
| Get it by Friday, Jan 9 if you order in the next 19 hours and choose one-day shipping. |
| Eligible for FREE Super Saver Shipping. |
(16)
|
| Excerpt - page 229: "... voluntary technique was proposed to keep robots out of where they don't belong and provide webmasters with a mechanism to better control their behavior. The standard was named the "Robots Exclusion Standard" but is often just called robots.txt, after the file ..." |
| Surprise me! See a random page in this book. |
|
| Books: See all 88 items |
|
| |
|
| 3. |
|
|
Web Services in the Enterprise: Concepts, Standards, Solutions, and Management (Network and Systems Management)
by Akhil Sahai and Sven Graupner
(Hardcover - May 2, 2005) |
| Buy new: $169.00
21 Used & new
from $82.50 |
| Get it by Friday, Jan 9 if you order in the next 19 hours and choose one-day shipping. |
| Eligible for FREE Super Saver Shipping. |
(2)
|
| Excerpt - page 208: "... within a page), - treatment of request redirection, - resource exclusions (such as images), - reconstruction of visits that span log file boundaries over time, - exclusion of robots and spiders, ..." |
| Surprise me! See a random page in this book. |
|
| Books: See all 88 items |
|
| |
|
|
| |