Search
Follow Us

Follow nosqldatabases on Twitter Follow nosqldatabases on Facebook Follow nosqldatabases on Google Buzz Follow nosqldatabases on LinkedIn Follow nosqldatabases on FeedBurner NoSQL presentations on slideshare

Sponsors

Become a sponsor of NoSQLDatabases.com. Contact us to find out how.

Featured Jobs

 

Follow On Facebook
Recent NoSQL News

Advertisments

Entries in Data Warehousing (1)

Monday
Jun142010

Hive - A Petabyte Scale Data Warehouse Using Hadoop

Now technically, Hadoop itself does not belong in the NoSQL discussion.  However, components that make up the Hadoop ecosystem such as HBase and Hive are definitely candidates for discussion. In this presentation by the Facebook Data Team, they discuss their usage of Hive in combination with Hadoop to solve Facebook's data warehousing and analytical needs.

I found it interesting how Facebook's blended the use of both traditional SQL data stores such as Oracle and MySQL and NoSQL solutions such as Hive as part of their overall solution.

Other interesting statistics:

  • 10 TB of compressed new data added per day
  • 135 TB of compressed data scanned per day
  • 7500+ Hive jobs per day
  • 80K compute hours per day