March 02, 2003

Deciding Which Robots to Block Is a Very Personal Matter

Recommended reading for a lazy Sunday morning. Patrick Nielsen Hayden writes:

Electrolite: Stuff I meant to blog last week: from Mark Pilgrim's uber-techblog Dive Into Mark, "How to block spambots, ban spybots, and tell unwanted robots to go to hell." Essential reading if you run a web site and pay for bandwidth, but what I particularly enjoyed was the sensation that I live in the science-fiction future after all. Writes Pilgrim, "Fighting robots is a neverending battle with no winners." And "The decision of which robots to block is a very personal matter." Well, we knew that.

Posted by DeLong at March 2, 2003 01:15 PM | TrackBack


I am happy to know that you are considering your users' privacy even in your leisure time.

Posted by: Amused Reader on March 3, 2003 12:58 AM

Prof. DeLong,

If you want to allow people to read your Semi-Daily Journal on their Palm or Pocket PC units, you should do what Mark Pilgrim does here:

I tried to grab your Journal as a custom channel through AvantGo but the resulting file is WAY too big. (AvantGo only provides 8 MB free.) I don't know how he does it but I assume that the process is automated somehow.

Posted by: Mark on March 3, 2003 03:22 PM
Post a comment