Optimizing Hadoop Workloads

We've highlighted several presentations that were given from this years Hadoop World all throughout the week including a presentation this morning from StumbleUpon. We continue with another presentation, this time from Intel.

Unlike other presentations that we've spoken about this week. This presentation does not focus on how Intel uses Hadoop. Rather it focuses on recommendations from Intel on how to optimize your Hadoop workloads so that you can get more work done with the cluster you have.

Click to read more ...

StumbleUpon Advertising Platform using HBase and Hadoop

StumbleUpon presented at this year's Hadoop World. Their presentation described how they built an advertising platform onto of Hadoop and HBase. What's interesting is how they are using a primarily batch oriented process to drive a real time process.

Click to read more ...

Hadoop and Hive at Orbitz

More slides and video from this years Hadoop World. In this presentation Jonathan Seidman and Ramesh Venkataramaiah discuss how Orbitz is using Hadoop and Hive. Specifically the presentation discusses how Orbitz uses Hadoop, Hive and machine learning to improve hotel ranking. In addition to the hotel ranking application, Orbitz is starting to use Hadoop for other projects such as: measuring page download performance, raw data log search and cache analysis.

Click to read more ...

The Hadoop Ecosystem at Twitter

We have more slides and video from this years Hadoop World. This particular set of slides and video comes from Kevin Weil's presentation about how Twitter is using Hadoop. Specifically this presentation explores how Twitter is taking advantage of both Hadoop and the various supporting frameworks/tools like Pig, Hive and HBase to support critical business and engineering problems.

Click to read more ...

HBase in Production at Facebook

Hadoop World, a conference put on by the folks at Cloudera, wrapped up a few weeks ago and slides and videos are starting to make their way out to the internet. Here is the video and slides from Jonathan Gray's talk about HBase in Production at Facebook.

This presentation by Gray focuses on how Facebook is using HBase for both online and offline applications. In addition it discusses why Facebook chose HBase, use cases that apply to Facebook and provides details on HBase usage on real-time applications as well as existing Hadoop-based data warehousing.

Click to read more ...