So once a week I pull roughly 250,000 RSS feeds in a single snapshot. Its not consistent and only represents what a slice of blogosphere has published at any given time. I've polled websites for years, and more recently URLs/RSS. An article on Business 2.0 got me interested in breaking up the entries by individual word. I was curious to just see how often some words were being mentioned. The Business 2.0 article was on who and what you should not being putting your attention into. It had the "Slashdot is out, and Digg" is in comment.

While I think Digg is a great site, I just do not buy the work Jeremy pointed out on Slashdot vs Digg. Digg may be growing, but I believe that its relevancy is not as high as Slashdot's. I also think that do to the nature of it being an open site with no editorial, eventually it will water down its own effect by being to broad.

The numbers:

mysql> select word_id, word, …