1 post • joined 28 Sep 2011
Big Data has a variety of different meanings. It can be a large data warehouse that you run data mining and analytics on. It could be an extremely large corporate database for on line transaction processing. It could be large unstructured or file system data that is managed through database meta data. Regardless, everyone's data repositories are growing exponentially to capture knowledge (lessons learned, etc) and accommodate ever emerging data acquisition technologies. The uses of data are also expanding rapidly for making key business decisions based on multidisciplinary data.
In my experience, if you want the most optimal application performance, you need to make sure the data operands are either in a core's register file or on chip cache. HPC to me means optimizing data movement using multiple level buffering from disk to SSD to memory to L3 cache to L2 cache to L1 cache so the processor cores do not stall waiting for data. Big Data means more effective data management, in-memory grids, large fast memory, and optimizing data access, movement, integration, processing, and real time delivery of results.
My 2 cents
- Breaking news: Google exec veep in terrifying SKY PLUNGE DRAMA
- Geek's Guide to Britain Kingston's aviation empire: From industry firsts to Airfix heroes
- Analysis Happy 2nd birthday, Windows 8 and Surface: Anatomy of a disaster
- Google CEO Larry Page gives Sundar Pichai keys to the kingdom
- Something for the Weekend, Sir? SKYPE has the HOTS for my NAKED WIFE