JVM Goes Big Data

SirSatish Ambati has an interesting presentation that discusses the various JVM scale issues that occur while working with big data.

Click to read more ...

Links of the Day - 2010/07/26

Links of the Day for July 26, 2010

• 200,000,000 Keys in Redis 2.0.0-rc3 - Jeremy Zawodny gives us some insight into the performance capabilities of Redis. He experimented with Redis in attempt to discover how much memory it would take to store 100,000,000 keys.
• 1,250,000,000 Key/Value Pairs in Redis 2.0.0-rc3 on a 32GB Machine - Follow up from Jeremy Zawodny in which he pushes the limit on his one 32GB machine by inserting 1.25 billion key/value pairs into Redis with some pretty impressive results.
• Building an InfiniteGraph Application with Maven - Todd Stavish is back with step by step instructions for building an InfiniteGraph application using Maven.

Links of the Day - 2010/07/19

Links of the Day for July 19, 2010

• Considerations for Hadoop and BI (part 2 of 2) - Part one of a two part posting that discusses various considerations to evaluate when considering using Hadoop for business intelligence.
• Java development 2.0: NoSQL - Provides a basis from which developers can get started with schemaless modeling in Java, specifically Groovy
• Notes from Sinatra, Heroku and MongoHQ deployment - Thibaut Barrere discusses various aspects on how he used Heroku, MongoHQ and Sinatra to create his latest side project.

Links of the Day - 2010/07/14

Links of the Day for July 07, 2010

• Social Graph Persistence In A Java Graph Database - Todd Stavish continues his in the mud approach to learning about NoSQL, specifically about graph databases. He demonstrates "how to construct and store a synthetic social graph of 9,100,260 (vertices, edges, and properties)."
• A Quick Overview of Graphing Databases - Good overview of several graph databases including Neo4j, InfiniteGraph and FlockDB.
• MongoDB (Single-Server) Data Durability Guide - Great article by Riyad that outlines "a number of ways you can increase your single-server durability using MongoDB".

Zero to Mongo in 60 Hours

Ryan Angilly, a Senior Developer from MyPunchbowl.com and self proclaimed "pretty awesome dude" brings us our next presentation about how MyPunchbowl.com integrated MongoDB into their software stack and into production in 60 hours.

Why did they choose MongoDB? Ryan lists six strengths of MongoDB:

1. Easy to get running
2. Open Source
3. Support in multiple (computer) languages. Prototype in Ruby, move to Java if necessary
4. Very active development
5. Full featured
6. Great ecosystem

Ryan does a good job of describing the various stages of development, testing and deployment. Finally, Ryan discusses where they are at 200 days later and what tripped them up during the process.

Java Development with MongoDB

James Williams, a Software Engineer at BT/Ribbit, demonstrates how to use Java with MongoDB. In addition, James introduces us to Morphia an open source Apache 2 licensed library that:

• Brings Hibernate/JPA paradigms to MongoDB
• Allows annotating of POJOs to make converting them between MongoDB and Java very easy
• Supports DAO abstractions
• Offers type-safe query support
• Compatible with GWT, Guice, Spring and DI frameworks

New player in the NoSQL movement, OrientDB

Interesting new participant in the NoSQL space, OrientDB. What is OrientDB?

OrientDB is a new Open Source NoSQL DBMS born with the best features of all the others. It's written in Java and it's amazing fast: can store up to 200,000 records in 5 seconds on common hardware. Even if it's Document based database the relationships are managed as in Graph Databases with direct connections among records. You can traverse entire or part of trees and graphs of records in few milliseconds. Supports schema-less, schema-full and schema-mixed modes. Has a strong security profiling system based on user and roles and support the SQL between the query languages. Thanks to the SQL layer it's straightforward to use it for people skilled in Relational world.

In addition to the features above it supports transaction. A feature that is often missing from other NoSQL data stores. I’ve added links both to the code hosting site and the project site as well. One other piece of info is that OrientDB is the creation of one individual, which is both impressive and scary at the same time. While it is released with the Apache license and code is available it does not yet have a huge community supporting it.

Orient Home Page
Orient Project Page (Google Code)