gleeco with my cribsheet for pcbc - DSC01113
gleeco takes a break - he was writing something badass to check-up on various cnet sites and make sure they aren't accidentally publishing incompetent and counterproductive robots.txt files. the cleverest bit he told me about was storing each site's entire /robots.txt file in his logs as a gzip-compressed field, which is brilliant imho.
copyright © 2008 sean dreilinger
Visit this image on flickr.
Usage terms: Attribution-NonCommercial-ShareAlike License.
Unique Descriptors
- cleaning up after misguided engineers ruin search presence
- robot exclusion protocol
- robot exclusion standard
- robots.txt
More Photos of…
- 2008-07-01 [65]
- C-NET-BS [10]
- advanced search technologies group at CNET [10]
- bring your kids to work day [10]
- california [2,199]
- cameraphone [285]
- camphone [444]
- cbs, inc. [10]
- cbs networks [10]
- cell phone camera [285]
- cellcam [444]
- cnet [95]
- cnet networks, inc. [33]
- cnet search.com [80]
- cnet.com [45]
- company [12]
- my slr is broken :-( [229]
- phonecam [442]
- san francisco [552]
- search engine optimization [53]
- seo [53]
- sony ericsson w810i photo [418]
- sony ericsson w810i sample photo [418]
- take your kids to work day [10]
- view all…
Search for Related Products
2008-07-01, C-NET-BS, advanced search technologies group at CNET, bay, beach, birthday, bridge, bring your kids to work day, buzzoutloud, california, cameraphone, camphone, cbs, inc., cbs networks, cellcam, cellphone, cell phone camera, city, cleaning up after misguided engineers ruin search presence, cnet, cnet.com, cnet networks, inc., cnet search.com, company, conference, freedom, graffiti, internetmarketing, mobile, my slr is broken :-(, ocean, phone, phonecam, robot exclusion protocol, robot exclusion standard, robots.txt, sanfrancisco, san francisco, search engine optimization, selfportrait, seo, socialmediaclub, sony ericsson w810i photo, sony ericsson w810i sample photo, street, take your kids to work day, telephone, tie, uae, Free 2-day shipping from Amazon.com
