About 6 months ago now I whipped up bowsah, a cute little app to scrape my web browser’s history file into a database and a surrounding rails app to munge the data.
So far it’s come in handy a few times for me searching for something I knew I’d seen on the web but couldn’t find, but mostly serves to measure how much time I actually spend on the internet. Here’s the past 24 weeks, equal to 164 days or ~5.5 months.
A few stats:
Is this too much? It may well be – but I don’t know. I’ve always used the computer lots, whether it was playing games when I was younger or reading lots of shit on the internet nowadays. I’m glad that I don’t spend all day watching TV or playing World of Warcraft, but could probably stand to see the honest-to-god light of day a bit more often or maybe even spend more time with actual people…
It is intrusive. It is voyeuristic. It is bliss.
I’m with this guy. If you know about facebook, you know that it’s kind of scary. And I swear to god, just the day before this came out I was thinking about how facebook had to be tracking all this stuff, what if 20 years down the road they started selling off people’s databases to the highest bidder or something. But now it just all goes right out there into the open, for you and everyone else to see. Brilliant. Now if it only came as RSS. (To let you in on how big a fucking deal facebook is, 2/3 of my friends have recently updated profiles (3 days), 1/8 have updated in the last 8 hours.)
So I’m apparently popular with the arctic explorers these days! I’m just awestruck. The other day Tony Haile stopped by and left me a comment, coincidentally on a book that I’d seen over at his site a month or two ago and decided looked good enough for a read.
Now I see that Ben Saunders (Tony’s partner in SOUTH, they’re leaving for a few months expedition to the south pole this fall(!!), an all around cool looking guy, who’s blog I’d also been following) links to me in his Elsewhere section, and as they apparently say over there in england, I’m chuffed.
I’m thinking that I’ll undertake adding in some sort of sidebar to return the favor, but for now here’s the good old linkage. And a good excuse for some bragging, I all to often take the I’m just some dumbshit kid approach to life.
Albert László Barabási
How everything is connected to everything else and what it means for business, science, and everyday life.
A nice look at networks and how they’re manifesting themselves in the world today. I read the book for class, it was a good class, and I think that all the talking about it we did there will only detract from the mulling over it gets here.
I’m not sure I’m a huge fan of the pop science genre – you can tell that the guy would just love to pull out his formulas and really get down to things; but he holds back and the whole book has a sort of wishy washy tone to it. An interesting read, but nothing really popped out at me.
Tim Berners Lee (inventor of the www) on net neutrality:
The Internet is increasingly becoming the dominant medium binding us. The neutral communications medium is essential to our society. It is the basis of a fair competitive market economy. It is the basis of democracy, by which a community should decide what to do. It is the basis of science, by which humankind should decide what is true.
(A letter to my representatives in government)
Network Neutrality: “in order to promote innovation, network service providers such as telephone and cable internet companies should not be permitted to dictate how those networks are used (i.e., not permitted to ban certain types of programs, to ban certain types of devices connecting to the network, or to favor carriage of traffic to certain web sites over others).” (from wikipedia)
If the above was a bit much for you, and I’m indeed hoping that this isn’t being read by some intern, watch a quick introductory movie on the issue. Here’s a link which is likely to be much more coherent then my letter; and here’s a whole collection of material on the issue.
The crux of things is that:
Right now there are laws against this. There’s a bill surfacing in the House, sponsored by Rep. Joe Barton, which passed through committee a week or two ago, and is headed for a vote in the house.
This centralization entirely contradicts the entire notion upon which the internet was founded and has flourished. In less then 20 years, the internet has left a bigger mark on our world than any other technology of recent invention. Allowed to continue to evolve and better itself, as it has done ever since it’s creation, only God knows what will come of it in the years ahead. Who could have foreseen just 10 years ago what it would be today?
This is bad, bad, bad. The only reason the internet has evolved to the point it has is that it’s a decentralized system which allows equal access to everyone with a computer and connection. The web as we know it has emerged from nothing but a conglomeration of research universities and government organizations, into a massive engine for learning, communicating, and commerce. Above all the internet embodies equality and liberty, and who would entrust such important values to any corporation?
Mike Davidson hacks his myspace page to (_gasp_) look decent.
Many MySpace outsiders knock the service because its garish appearance and overall clunkiness overshadow anything good that may be underneath.
I’m going to say that’s a pretty damn good reason not to use the thing. But I might just have to make a profile and take it out for a spin sometime this summer.
So I’ve got a rails app up that is handling bigger datasets then I’d imagined it would. It’s not doing so well and now I need to go through and optimize things. Ugh. But check this out:
[kjell@ambrose:~/Sites/quizzer] % cat production.log | wc -l
1541890
That’s a 1.5 million line logfile. Again, Ugh. At least people are using and mostly liking my system. Too bad it looks like it’s ridiculously inefficient. But ah, the joy of computers. Just think about that – it comes close to blowing your mind.
Use odeo to leave me voicemail from your browser. I signed up right when odeo came out, but haven’t been too much into this whole podcast thing.
Four jobs I
Steve Krug
A good look at usability in web design. Quick read with nice illustration. I got the second edition, all nice and glossy, and had I been going anywhere on an airplane, likely could have finished reading it while up in the air.
Not too much to say about it, but that it will be a nice one to have on the shelf to peek at.
The overall idea is that of common sense – make things easy for the people using your website. Test the site against actual people to see what needs improvement. Test early in the development cycle, so that feedback can quickly be integrated into the site.
Applies more to static web sites. There isn’t lots directly applying to web apps, which is more what I’m interested in, but most of it rubs off in some applicable fashion.
1.0 really doesn’t mean much, I’m running on edge rails and have all kinds of cool stuff that wasn’t included (rjs, anyone?). But it’s great none the less.
I'm sure I'm not the only one to have figured this out, but is this cool or what?
:complete => { visual_effect(:BlindDown, dom_to_update, :duration => 1),
visual_effect(:highlight, dom_to_update, :duration => 1) }
Everyone in college uses facebook. I’m slowly starting to like it.
I wish my dog had a website. Khoi Vinh’s dog has one.
I’ve been working part time in php lately, and trying to make it as much like ruby as I can. It’s tolerable, but I haven’t had to do anything too hard or complicated yet. Won’t be converting anytime soon.
I’m blocking out a site for my yet to be realized business, and it looks lots like this. Almost exactly, but with different colors. Me like.
My remit? Nothing but content. The content is king. Nice big bold blocks of text. All the fancy stuff kept hidden.
Google video works in safari since I don’t know when, but it rocks.
Your attention can be easily tracked on the web, and it is. Why shouldn’t you get to own it?
I’m doing a questionnaire app with rails for the psych department at Morris, and this will kick ass when it comes to implementing questions on a scale.
gmaps + plus weather = neato.
Neat css hack to disable advanced styles in IE, done and now this all looks presentable to windows folk IE users.
Bigger then 2000. Will growth in the internet predict global economic improvement? The converse?
Ning is starting to look kind of cool:
All content is available to everyone else, unless it’s marked private.
So what we have is not a hosted framework service, but an ecosystem. An ecosystem that not only allows but relies on the ideas of remixing, mashups, and openness.
I haven’t got a developer key yet, nor looked through any docs – but hopefully on top of that it’s easy to aggregate to your own apps outside of ning.
I’ve wanted something like this for awhile now – tracking of every page you visit. Hopefully on top of using it to improve searching we can have some cool representation of where we’ve been on the web.
Google Star Search solves that problem: when you visit Google you can now choose between a full-Web search and a search limited to the pages in your history; a full-content, ranked query of everything you
More rails hotness, this time a personal finances app from Jamis Buck. I like it.
Bloglines doesn’t give you a number here, but I’m at 248. Time for a bit of weeding. (two minutes later: 249.)
I’ve got a killer startup idea up my sleeve, and maybe twenty percent developed. I want to launch it – I think it could really have a market – but have the slightest idea how.
I will use this blog to document on a weekly basis the startup process from beginning to end. I think it will be very interesting to all to compare theory to practice.
CODE IS POTTERY
Sweet presentation on web interface design. Direct to presentation. links.
Second, and this is something I’ve been percolating for a long time, I wanted to focus more on the page bottoms. Page bottoms are the most valuable screen real estate there is. You read that right. All that nonsense about people not reading and not scrolling is complete bullshit.
In my last redesign I moved the sidebar into the footer – I think it works much better there. I’ve been meaning to fit more down there, and I like what Mr. Powazek has done.
I’ve been looking to grow this site into more of a tumblelog, and was thinking about going my own with the CMS. But this looks pretty good:
your music, photos, blog entries, bookmarks, what you wear, what you eat, what you buy, trips, how far you bike, exercise, vacations, pregnancy, goals, net worth, engagements, school, quotes, chats, movies and entertainment, people you see, weight, what you cook, journal entries, and anything else…
I spotted this yesterday, it made me a little giddy.
Reading Jason’s post about the same book just about made me explode – I want to read it now!
I’m maybe a quarter of the way there: I sort of know what I’m doing (I wish I knew more) and have done a little professional work on the side. I’d love to make the jump, or at least increase my workload/earnings.
A new book is coming out of the crew from 37signals, Getting Real.
Like greasemonkey, only not a firefox only extension. And with ruby!
What is a huge deal? Having an extremely
Kevin Kelley on what the web is going to become. This guy has the real scoop on Web 2.0.
What happens when the data flow is asymmetrical – but in favor of creators? What happens when everyone is uploading far more than they download? If everyone is busy making, altering, mixing, and mashing, who will have time to sit back and veg out? Who will be a consumer? 4
What will most surprise us is how dependent we will be on what the Machine knows – about us and about what we want to know. We already find it easier to Google something a second or third time rather than remember it ourselves. The more we teach this megacomputer, the more it will assume responsibility for our knowing. It will become our memory. Then it will become our identity. In 2015 many people, when divorced from the Machine, won’t feel like themselves – as if they’d had a lobotomy. 5
It’s on.
Dave Thomas, et al.
I’m a little late catching the bandwagon, but I didn’t buy the (beta)book for a few weeks after it’s release. This is a spectacularly detailed book on the rails framework, capturing the simplicity of setting up a rails application in it’s tutorial followed by quite a dense summary of the different aspects of rails quite in depth.
I remember 37signals announced this even before backpackit, but nothing ever came of it. Maybe I’m crazy. But coming from them, I bet it will be jaw droppingly cool, even if I never use it.
Cute way to generate cached image files from your db with rails.
Cool looking php calendar frontend for .ics files, complete with ajaxification. I’ll be looking to install this as soon as my new computer comes and I get it set up.
Try this – type some product into the location bar of firefox (I pasted motorola i860 there instead of in the google bar) – and whoa! Firefox routes me to the particular phone at phonescoop.com. works with nokia [model number], apple powerbook, windows xp… neat.
The phone looks cool because of a neat little easter egg that lets you upload your photos (with latitude and longitude) to flickr instead of motorola’s own photo site. I want a gps phone.
update: are you kidding me?! I ordered my powerbook, and have compulsively been checking the status of the order since. Type apple store order status into the location bar, and boom! I get to the sign in page to view my order status. I wonder if it looks through my history and learns new places and keywords for them, in addition to some basic ruleset thats programmed in (because I’d never been to the windows xp page or the phonescoop page, but it still worked). Wow.
update again: Firefox redirects you to googles first result for whatever query you put in the location bar, and its very very useful.
Another cool looking new online feed reader. I was thinking about rolling my own, but this has a lot of the most important things I will want – keyboarding and a killer interface (thanks terrell).
Great collection of essays and tutorials on all different kinds of web design.
A new site to catalog, discuss and develop mircroformats, the new hotness on the web.
Justin French, who managed to get a sweet job at textdrive, on how to start your web entrepreneurship.
In my humble opinion, the key to starting a freelance career or small business boils down to a few very simple ideas:
Neat (tag based :b) site for finding and browsing different color swatches.
Google’s related: is a fascinating way to web surf. Also, google cheat sheet
I hate driving, and I think I’d be quick to kill myself before commuting on the freeway everyday to work, but this mashup of google maps and yahoo traffic is real neat.
A nice intro to the basics (I do mean basics) of design. I’m getting ready to try another visual design for this site – and I’m looking for a little reading because I really don’t know what I’m doing when it comes to design.
Looks nice.
Textdrive turned one today, which means that this site is officially one also. I’d been running it locally on my box, and registered the domain name as soon as I bought the VC 200 account (5/26). Then I spent a few days anxiously awaiting the results of my purchase. I’ve been happy ever since.
Now, on to Rails. Rails is the most well thought-out web development framework I’ve ever used. And that’s in a decade of doing web applications for a living. I’ve built my own frameworks, helped develop the Servlet API, and have created more than a few web servers from scratch. Nobody has done it like this before.
So rails, starting to get hot, huh?
Firefox is just getting way too cool to keep shunning. Safari might feel and look better, render or render a little faster – but firefox has so many cool scripts and extensions to play around with, I have trouble not seeing myself switch over eventually.
At least almost.
<a target="_blank" href="http://211.189.88.203/www.paypal.com/us/cgi-bin/webscr=cmdxpt/cps/clickthru2/Billing-Verification=CookieId=4801de10f2194572779a171135820269/">https://www.paypal.com/cgi-bin/webscr?cmd=_login-run</a>
You criminals are going to have to work harder then that to get my paypal login out of me.
Kottke comes up with another neat home page outside the box weblog feature – keep your weblog’s front pages from being so boring. Might have to take it from him like I did remaindered links.
Sweet website, I’ve had in in my feed since I read Mind Hacks but what a cool design, I love the no images/sweet styling combination.
Why we like rails:
Ruby on Rails is turning out to be that place in the middle capable of igniting excitement from both ends of the spectrum.
So what we’re basically trying to achieve is the meeting of quick’n’dirty with slow-but-clean into quick’n’clean.
Man I’m lucky. My web host rocks – and I don’t even have to pay it any more.
And the tail? The site was still doing the same concurrency and number of requests, but the load had dropped to 4 and memory usage to 0.5GB. Incredible
To me, this was the first real demonstration of lighttpd’s superior abilities to handle concurrency and load, and “sealed the deal”. I see us doing Apache-proxy-to-Lighttpd as our default setup right now, because I feel that when you have servers that are dual 3.6Ghz xeons with high speed SCSI drives on dual RAID1/RAID5 split backplanes, your web server should be to keep with that.
Matthew Linderman and Jason Fried
What you should do to foolproof the ‘critical’ points of your website. How to keep people from getting frustrated while trying to accomplish their goals, ultimately allowing them to do buisness with you instead of getting pissed and walking off.
Cringely paints a gloomy situation in which telcos and cable providers begin to discriminate against packets not affiliated with their own services, stifling competition and innovation against the web. And what could anyone really do about it?
I’m no designer, I think these guys have me on that issue – but this is definitely how to keep your site fresh:
We have a lot of ideas for the new SvN, and over the next few months you’ll be able to watch us think out loud. The site may be different tomorrow. And different again the next day. The design will be ever changing until we settle on what we’re really happy with. But instead of doing it all behind the scenes, we’ll be doing it in the open.
Why keep all the changes you want to make to your site in a to do list somewhere when all they really take would be 5 minutes of fiddling with templates or css? Just do ‘em, make your site better, and get out of that ‘redesign’ state of mind.
A great interview between a few internet mavericks – Greg Storey and jason Kottke.
Airbag: How does it feel knowing you can never go back to being an amateur, that you can’t participate in Olympic competition?
Kottke: I’m sorry, I can’t hear you over the sound of my money counter.
It’ll be interesting to see how this turns out for kottke – I don’t think I’ll ever be able to hold down a job, maybe I should turn pro and blog all day (but I don’t think that would float my boat either).
Asynchronous javascript and xml, or – the future of web apps. I heard DHH mumble something about putting a lot of the xmlhttprequest bits he had been working on for his next big project into rails – and I can’t wait. This stuff really is cool.
A nice guide to spacing and labeling and coloring and general web form design.
Address Book and iCal on the web in ruby, anyone?
Static category/section navigation could be very wrong, not at all embracing the user and allowing him to accomplish his goals.
The findings suggest that navigation should be a prominent part of a website. Instead of being discrete appendices separated from the rest of the site, navigation should be integrated into the site and make sure that users stay in the flow.
...why should we place this burden on people if we can design navigation schemes based on how people actually navigate.
It’s a desktop app in my browser over the web – and it uses XmlHTTPRequest, not flash! I declare it year of the web application.
Color of the year – here I come. I love brown!
Really simplifies making flash for someone without Flash.app… or any knowledge of actionscript. But would it be better to just learn how to make flash?
A little more about that amazing hosting deal I talked about in my entry yesterday – it was part of an incredibly good deal offered to finance a new startup web hosting company, TextDrive.
The deal was this – for $199, you purchased a hosting plan for one year. That comes out to about $16 dollars a month, and that compares fairly well to other webhosts for the features1 it includes.
But the amazing part of the deal is that in addition to the first year, you would continue to have the best offering of TextDrive for as long as the company exists. Yes, it blew me away when I first heard it too.
I wasn’t quite sure when I first saw the deal early monday morning (right when Dean posted it in the textpattern forum), but I went to bed, then school, and by the time I got home I decided that it was well worth the money.
I scraped some dollars together, collected all the money my friends owed me that day at school, then went to the bank and threw all of it in. I already had plenty more then the cost in there, but I didn’t feel like burning too big a whole in my balance.
And I still can’t convey how anxious I am to get my confirmation – although I bought very quickly and the shares didn’t sell out until today, I still haven’t got anything more then confirmation that my payment went through to Dean from paypal. But Alas, I’m positive that I got in.
What really impressed me about this deal, more then the specs and the lifetime gratuit, was the attitude that the two men behind it (Dean Allen and Jason Hoffman) took towards the project. They weren’t out to make all kinds of money – that wanted to provide people with the kind of hosting that they thought would be great.
We