My browsing habits for the past 2 months. Pages per day is a crude metric, but good enough to get an idea of how many I look at per day.

I wrote a little script that scrapes ~/Library/Safari/History.plist and throws the the page title and url into a 150 line rails app which spits out basic info and lets me search through to try and find pages I remember but otherwise would have a hard time getting at.

The sqlite3 database is at 2MB after 2 months, I don’t think that 1MB/month is an unreasonable size to keep track of the pages I’ve been too. It might start getting unreasonable a few years from now, but nothing that can’t be handled then.
I don’t know why I wanted to have all the pages I go to logged into a system, even just for private use. Something about leaving a trail, having instant recall. I probably read more stuff on the internet than I do out of books, and I could remember for the most part what books I read, but there’s no way I could keep track of the thousands of webpages I go to every week.
It also just puts things in scale, I mean holy shit. In the past 7 days I’ve been to ~2300 pages. Not all different pages. In the whole 2 month period this thing’s been going, I’ve been to ~1900 different sites (judging by top level domain). That’s a lot of browsing.
The big idea that I feel is behind all this: when I’m 40 I’ll be able to come back and sit down and take a look at all the data I’ve left behind. Maybe figure out what my life had been like at some point in time. What websites did I visit 20 years ago today? Where did my interests lay, what kind of stuff did I like? It might end up being a dry, boring as hell legacy; but there’s potential for it to be interesting as well.
I remember 37signals announced this even before backpackit, but nothing ever came of it. Maybe I’m crazy. But coming from them, I bet it will be jaw droppingly cool, even if I never use it.
Asynchronous javascript and xml, or – the future of web apps. I heard DHH mumble something about putting a lot of the xmlhttprequest bits he had been working on for his next big project into rails – and I can’t wait. This stuff really is cool.