Talk:Bots spiders and crawlers

Comments, fwiw:


 * What's a "scrawler"?
 * The .htaccess link doesn't show user-agent blocking (or I missed it).
 * Shouldn't KB_/_Web_Programming_/_Miscellaneous be deleted now?

--0-0 20:46, 28 Nov 2006 (PST)