Monthly Archives: June 2009

Catching up on Velocity 09

This year I could not attend Velocity so I decided to catch up via http://velocityconference.blip.tv. Here are a few notes on the sessions I have been able to see so far. John Allspaw (Ops) & Paul Hammond (Dev): 10+ Deploys … Continue reading

Posted in culture | Leave a comment

Started a friendfeed webops public group

Feel free to join: http://friendfeed.com/web-ops

Posted in cloud computing | Tagged , , , | Leave a comment

#structure09 Hosting on commodity hardware

I just got out of the panel on commodity hardware and did not get a chance to participate so here’s my take on it. The panel started with an opening question: google, amazon and the likes run at a huge … Continue reading

Posted in architecture, cloud computing, infrastructure | Tagged | Leave a comment

I love Amazon Web Services open pricing

I’ve just spent 2 hours crafting a spreadsheet to compare how much it would cost to set up a decent platform to deliver the kind of data services I manage, vs. the same on EC2. Easy access to pricing is … Continue reading

Posted in Uncategorized | Tagged , , | Leave a comment

How about sub-second queries in Hadoop?

Two observations from talking and listening to people during the Hadoop summit; firstly hadoop is used quite often to process clickstream data — in all fairness I missed the talk about hadoop used for genomics. Secondly and a corollary of … Continue reading

Posted in architecture, database, distributed computing, infrastructure, rdbms, scalability, yahoo | Tagged | Leave a comment

Notes from the 2009 Hadoop Summit West

I just got back from Santa Clara where Yahoo and Cloudera were hosting the 2009 Hadoop Summit West on Wednesday followed by a training on Thursday. My interest was one of a prospective user — to gauge how real and … Continue reading

Posted in infrastructure, scalability, storage | 1 Comment

Very interesting talk about SmugMug

A few key points: 2 ops people, automatic scaling, 1000s of cores on EC2, PBs of storage on S3. http://mysqlconf.blip.tv/file/2037101

Posted in architecture, cloud computing, infrastructure, production, storage, technical | Leave a comment