Archive for March 5th, 2007

Blogs-A Vast Universe of Bots Reading Each Others Stuff? -But Do Any Humans Read Them?

Monday, March 5th, 2007

The statistics of this blog include a browser report.  It lists the number of  #requests, #pages per browser agent used to access this blog.   If you look at the list below its a challenge to find the user agent that is used by a human.

In order to sort things out you can search for the user agent using Google or using botsvsbrowsers.com

The first entry is suspicious but is not a KNOWN browser.  However I find it strangly verbose and thus suspect: 

—Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; AT&T CSM8.1; .NET CLR 1.1.4322; .NET CLR 2.0.50215; InfoPath.1—

Whereas the following are known obvious bots:   http://tailrank.com/robot, http://www.google.com/bot.html , http://irl.cs.tamu.edu/crawler , http://help.yahoo.com/help/us/ysearch/slurp.  

The fact is as I look at the list carefully I’m suspect of everything on there. I really wonder if this blog phenomena is a bit different than how I would have assumed it to be.  I had no idea before starting it that the main reader of it would be machines.   My suspicion is that people are attempting to automatically detect / aggregate blogs in efforts to wring out Google syndication fees.  I am not sure totally sure.   I’ll assume I’m talking to myself until I prove otherwise.

Since originally writing this note a while back I have noticed in my stats that this article is consistently near the top of the reads.  I assume its other people dissecting their stats figuring out who / what is reading their stuff. 

 

 227 17 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; AT&T CSM8.1; .NET CLR 1.1.4322; .NET CLR 2.0.50215; InfoPath.1
64 64 Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Tailrank; http://tailrank.com/robot) Gecko/20021130
54 54 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
30 30 IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)
28 28 Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
22 1 Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; InfoPath.1)
21 1 Mozilla/4.0 (compatible; MSIE 6.0; AOL 9.0; Windows NT 5.1; SV1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0)
17 1 Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.2) Gecko/20070219 Firefox/2.0.0.2
16 16 Technoratibot/0.7
13 13 msnbot/1.0 (+http://search.msn.com/msnbot.htm)
10 10 User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
9 9 Feedster Crawler/3.0; Feedster, Inc.
9 3 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
9 1 Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.8) Gecko/20050927 Debian/1.7.8-1sarge3
7 7 Java/1.5.0_06
7 2 Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.7.12) Gecko/20050919 Firefox/1.0.7 (ax)
7 1 Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
6 1 Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
6 1 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
6 1 Mozilla/5.0 (Windows; U; Windows NT 5.0; es-ES; rv:1.8.1.2) Gecko/20070219 Firefox/2.0.0.2
6 1 Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
6 1 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; .NET CLR 2.0.50727)
5 5 YahooFeedSeeker/2.0 (compatible; Mozilla 4.0; MSIE 5.5; http://publisher.yahoo.com/rssguide)
4 4 Yoriwa/0.1 (compatible; Mozilla 4.0; MSIE 5.5; robot@yoriwa.com)
4 4 Syndirella/0.92
3 3 Sphere Scout&v4.0 (beta) - scout at sphere dot com
2 2 Mozilla/5.0
2 2 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; APC; .NET CLR 1.0.3705; .NET CLR 1.1.4322; .NET CLR 2.0.50215; InfoPath.1)
2 2 Moreoverbot/5.00 (+http://www.moreover.com)
2 2 Plagger/0.7.17 (http://plagger.org/)
1 1 SurveyBot/2.3 (Whois Source)
1 1 Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)
1 1 Biz360 spider (blogsmanager@biz360.com; http://www.biz360.com)
1 1 Baiduspider+(+http://www.baidu.com/search/spider.htm)
1 1 http://www.relevantnoise.com; info@relevantnoise.com
33 0 [not listed: 2 browsers]

Clarence Thomas - Prejudice Versus Postjudice and Free Thinking and Violating Expectations

Monday, March 5th, 2007

I love Clarence Thomas.  He’s so clear in his thoughts. He’s so conservative in his rulings.  He so violates the left’s expectations of blacks that they he induces strokes in them.  Let me demo the thought processes inside a lefties head and mine to contrast how an idiot and a thinking man uses prejudice to bad and good effect.

Lefty-Idiot Media / Lib Reaction to Clarence Thomas:

1) See race=African assume person will have a set of traits / beliefs.  Pretend to not pre judge.  This is to say they are pretending not to be prejudiced.

2) Not meeting expectations the media / libs savage the thoughtful Clarence Thomas in words

My Reaction to Clarence Thomas:

1) See race=African and assume there is a weighting of probabilities towards a certain set of behavioral traits. Realize these are probabilities and not certainties. Includes 90% chance he votes democrat and probable annoying tendency to rhyme when making speeches. 

2)  Having seen a thoughtful valuable person I react positively.

 

Prejudice is commonly defined as judging someone before actual behavioral data is known about them.  We can know things based on skin color however on a statistical basis.  However when people don’t meet your expectations you may want to consider being cordial to them regardless.  They may just deserve it in some cases. 

But then as Clarence Thomas said One of the reasons I don’t do media interviews is, in the past, the media often has its own script. One reason these stories are never told is that they are contrary to the script that people play by. The media, unfortunately, have been universally untrustworthy because they have their own notions of what I should think or I should do”

————

We are so lucky this guy stays on at the supreme court.  The poor fools out there don’t appreciate what we have in Clarence Thomas.  My heartfelt thanks CT.