How Facebook keeps 100 petabytes of Hadoop data online

[res0nat0r]

http://gigaom.com/cloud/how-facebook-keeps-100-petabytes-of-hadoop-data-online/

Hadoop is freaking cool and is one of the most fun things I get to play with for my job. This article is pretty sweet.

I didn't deal with anything near 100PB, but greping through ~2TB of logfile data each month for interesting stuff is still pretty fun.

[picklemonkey]

Re: How Facebook keeps 100 petabytes of Hadoop data online

I grep through logs every month for personal projects, it's cool to see how people are using your tools

[res0nat0r]

Re: How Facebook keeps 100 petabytes of Hadoop data online

Hadoop is awesome. You can do some pretty amazing things easily. It's cool launching 100 servers and waiting 10 mins and they are up and having a 500TB distributed filesystem at your fingertips.