The Square Kilometer Array (SKA), a radio telescope being built in both Australia and South Africa and expected to actually cover 5 square kilometres of ground, will produce enough raw data to fill 15 million 64GB iPods a day. That’s equivalent to every piece of information sent and received over the entire internet. Twice.
But it’s alright. You don’t have to rush out and panic buy iPods. Most of that information doesn’t tell us anything and gets thrown out straight away. Working out what to lose and what to keep, however, is one of the most challenging aspects of any project as big as the SKA.