From MySQL to MongoDB at Wordnik

Tony Tam from Wordnik describes their migration from MySQL to MongoDB. So why migrate from MySQL? Inserts on their MyISAMTables had approached 10 seconds an insert. They continued to produce workarounds. However, this led to an increase in system babysitting. Nothing than a fragile system to make those weeknights and weekends extra fun, right?

What are the results?

• Moved 5 Billion rows from MySQL to MongoDB
  • Sustained 100,000 inserts/second
  • Migration tool was the bottleneck (CPU Bound)
• Wordnik now reads from MongoDB very fast
  • Read + create java objects @ 250,000/second

What about the advice of going live with MongoDB?

• Choose your use case carefully if migrating incrementally
• Scary no matter what
• Test your perf monitoring system first!
• Use your DAOs from migration
• Turn on MongoDB on one server, monitor, tune (rollback, repeat)
• Full switch over when comfortable

As a follow-up Wordnik discussed in a post that they are now hosting 9 billion documents. Read more at B is for Billion

Implementing MongoDB at shutterfly

Kenny Gorman, Data Architect at shutterfly shows us how some NoSQL data stores are ready for primetime. In this case it's MongoDB. This presentation discusses how shutterfly started to make the transition from a traditional Oracle RDBMS to MongoDB. The results, 500% improvement in cost, 900% improvement in performance and shards on demand. Pretty impressive.

Couple of interesting stats about shutterfly:

• 20TB of RDBMS storage
• 10000 ex/sec
• 6 Billion photos
• Adding 400TB a month

Key lessons learned:

• Keep it simple
• Data Modeling
• Walk before you run
• Use Jira for MongoDB issues
• There is life after Larry



Schema Design with MongoDB

If you ask most developers to design a schema for a traditional relational database they would have no problem doing so. However, introduce a document oriented database like MongoDB and they might struggle. Fortunately, Dwight Merriman, CEO of 10gen, has come to our rescue. In his presentation he walks through a couple of different use cases and describes techniques to handle those use cases.

Zero to Mongo in 60 Hours

Ryan Angilly, a Senior Developer from MyPunchbowl.com and self proclaimed "pretty awesome dude" brings us our next presentation about how MyPunchbowl.com integrated MongoDB into their software stack and into production in 60 hours.

Why did they choose MongoDB? Ryan lists six strengths of MongoDB:

1. Easy to get running
2. Open Source
3. Support in multiple (computer) languages. Prototype in Ruby, move to Java if necessary
4. Very active development
5. Full featured
6. Great ecosystem

Ryan does a good job of describing the various stages of development, testing and deployment. Finally, Ryan discusses where they are at 200 days later and what tripped them up during the process.

Java Development with MongoDB

James Williams, a Software Engineer at BT/Ribbit, demonstrates how to use Java with MongoDB. In addition, James introduces us to Morphia an open source Apache 2 licensed library that:

• Brings Hibernate/JPA paradigms to MongoDB
• Allows annotating of POJOs to make converting them between MongoDB and Java very easy
• Supports DAO abstractions
• Offers type-safe query support
• Compatible with GWT, Guice, Spring and DI frameworks

Flexible Event Logging - Analyzing Funnels, Retention and Viral Spread with MongoDB

his presentation is by Paul Gebheim from Justin.tv. In the presentation Paul discusses how MongoDB helped answer create:

A general framework for create, deploying and analyzing A/B tests in terms of Funnels, Virality and Retention

In addition, the solution should be flexible, queryable, scalable and easy to work with. So how do you do it? With Python, Map/Reduce and MongoDB. Paul walks through the use cases and shows how justin.tv uses this recipe to create the framework.

8,000,000 operations per second

That is the level of performance that Eliot Horowitz has reached with MongoDB. The following are the slides from his presentation on sharding and a link to the video of the presentation as well.