IBM Research has come up with a new package it calls BLU Acceleration, intended to speed up (big) data analysis and reporting of data held in DB2 and Informix databases, amongst others. The BLU Acceleration package includes these handy features: Data skipping - an ability to skip data that doesn't need analysing, such as …
If you have more data than memory...
The more data than memory problem is hard to solve without nearline-media. Since Big Data typically has non-relational data as a large component, perhaps they do lossless compression or invoke some kind of minimally lossy compression.
Lossy stuff can be novel compression or somehow suppressing duplicate (or near-duplicate) information, without losing any analytical capability. That is working rather well in many enterprise backup approaches...
- Xmas Round-up Ghosts of Christmas Past: Ten tech treats from yesteryear
- Analysis Microsoft's licence riddles give Linux and pals a free ride to virtual domination
- Review Hey Linux newbie: If you've never had a taste, try perfect Petra ... mmm, smells like Mint 16
- Special Report How Britain could have invented the iPhone: And how the Quangocracy cocked it up
- I KNOW how to SAVE Microsoft. Give Windows 8 away for FREE – analyst