Through a very circuitous and serendipitous path I chanced upon Ken Pomeroy's college bball statistics project. I believe the game scores were collected in a distributed fashion, and then made freely available for sports stats wonks to munge. I guess I'm slowly penetrating the community of peer-2-peer, non-baseball stats collectors I dreamed of when I was a regular on USENET's rec.sport.basketball.[pro,college]. If you have any Google chops, you can figure out who I was.
In any event here's my route. Daily Python URL > Bill Mill > game data > Ken Pomeroy > Ken's blog > Ken's stats project.
Ob geek talk. I essentially have two bins of feeds I'm subscribed to. One for monitoring, and one for serendipity. I need to build a tool that I can hand the serendipity bin to for filtering, clustering, analyzing, and visualization, so I can process potential serendipity items faster. The monitoring bin I could use to drive a focused crawler.
Back to the mines!!