Vanessa Fox discuses the Robots Exclusion Protocol and Managing Robots Access To Your Website, including managing capabilities and implementing the REP, plus she answers a listener question about page redirects that are disallowed.
Robots txt The Definitive Guide
Posted by David Brown on June 12, 2008 in Announcements, Consulting, Resources, Robots · 2 Comments

Nope we’re still here and kickin! Brian has been slammed and I didn’t know how he was posting up the episodes… now I do, I should be able to stay on top of them pretty well ;)
Thanks for listening!
DB
Thought you guys were about to stop with the great shows. Apparently not :)…very glad to see a steady flow of great podcasts again. Thanks alot, gonna grab the latest eps….time to get the class started again :)
Thanks alot!