* Posts by omnibuzz

1 publicly visible post • joined 28 Feb 2013

Big Data tools cost too much, do too little

omnibuzz

Good perspective.. but...

Cannot agree with you more.. At the same time cannot disagree with you more either. I am SQL fanatic and love RDBMS. But, I have to agree that No-SQL brought in a plethora of database "types" like key value store, graph databases, document databses, XML databases. It was paradigm shift from modeling on data persisitance to modeling on data usage. No-SQL databases have got very little to do with size of storage and more to do with applications and even more to do with talent within the organization , openness to a better programming paradigm and of-course performance requirements.

Having said that, I totally agree that going to Hadoop for a few terabytes of data is an overkill. More than the hardware, it's the problem of expecting your existing data analysts to start thinking map-reduce and ending up losing the in-house talent in the process.

And, finally, if you are definitely going big data, I would ask the data analysts/scientists/DBA who will code on the platform and eventually maintain it and derive business value out of it to spend some time on HPCC Systems and the ECL programming language before making a decision. I tried it and I love it and I find it as a good entry to big data with the least change to your mental make-up. I feel it augments your SQL skills instead of killing it.

-omnibuzz

sqlpointers.com