Big Astronomy Destroys Big Data

<http://www.theregister.co.uk/2017/01/18/murchison_radiotelescope_opens_the_science_firehose/>: A curious detail in the CSIRO blog post caught Vulture South's eye: ASKAP is producing 5.2 TB per second of data, which the CSIRO reckons is equivalent to about 15 per cent of the current data rate for the whole of the Internet. That's bigger, by a nice fat margin, than two things: the connection from Murchison to the Pawsey supercomputer centre in Perth; the amount of disk available once the data arrives in Perth. Clearly, there's a serious amount of data reduction happening along the way... In short, 5.2TB/s of raw data in, 22MB/s of high-res image data out. The latter is what’s stored for further processing.
participants (1)
-
Lawrence D'Oliveiro