We've expanded our news coverage and improved our search! Visit
oreilly.com for the latest or search for all things across O'Reilly!
Article:
 |
|
Top Ten Data Crunching Tips and Tricks
|
| Subject: |
|
Working on big data sets |
| Date: |
|
2009-08-11 01:15:34 |
| From: |
|
Bozdag
|
|
|
|
It usually takes hours or maybe days if you want to crunch a huge volume of data. It is almost impossible to load everything on to memory. Then, what is the best practice to read and transform that data? Using a RDBMS or a special file format like HDF5 ? |