Hadoop and Storage Area Networks

I get asked frequently why one would not use a Storage Area Network (SAN) or Network Attached Storage (NAS) for Hadoop, so I thought I might take a moment and try to explain why you don’t need external storage of any type with Hadoop.  Hopefully this posting will help you become more comfortable with the capabilities of Hadoop’s native features and optional modules and demonstrate that a SAN or NAS may not be necessary for you.

First of all, let’s look at the types of things you get in an Enterprise-class SAN or NAS as it pertains to what you might want with a Hadoop infrastucture: Continue reading “Hadoop and Storage Area Networks”

Big Data and Linux…what the numbers say

Unix is dead!  Love live Unix!  Oh the days when Linux arrived on the scene and I spent hours…day and night, hacking, compiling, recompiling, building, etc., because Linux was the future, and it was fun to create.  And, while I didn’t make too many New Years resolutions this year, one of those that I did make was to shut down my work computer at a decent hour, and that that included my reading of anything tech related as I have spent a good portion of my adult life reading magazines and websites off-hours until I could absorb no more.  So last night I was on Facebook at midnight Eastern time when I saw this little gem…titled “Linux lovers love big data” which is a survey done by the Linux Foundation.  Being a LONG time Linux and Open Source professional I just had to read it…break my rule…one time.  While I was not surprised with what I saw, I think it is a telling reminder of what many in the IT community think about what workload works best with what Operating System.

Continue reading “Big Data and Linux…what the numbers say”

The Year In Review…

I need to first apologize to my readers…it’s been several weeks since I wrote anything.  I had some personal business to attend to that kept me away from writing, and in that time, so much has happened…I don’t know where to start.  So rather than figure that out, I’d like to look back at some of the biggest stories of the year in terms of how the Cloud evolution started the year, and how it ended the year.  No…it isn’t a timeline approach and I am sure I’ll miss something as there was SO much that changed this year in Cloud.  But an exciting year it was, and an exciting year it will be in 2012.  At least until we all die on December 21st. Continue reading “The Year In Review…”

Hadoop World Day 1

I have been to a lot of trade shows in twenty years in IT, but I have never been to one that actually sold out. Not until today. Hadoop World 2011 started off with a bang and kept going all through the afternoon and into the evening. From the kickoff Keynote by Mike Olson, Cloudera CEO to the Networking Reception sponsored by Dell. Continue reading “Hadoop World Day 1”