Herbert Mühlburger's Blog » Hadoop

NoSQL Databases: Why, what and when – An Overview on NoSQL Datastores

Herbert Mühlburger — Sun, 06 Mar 2011 19:31:59 +0000

For everybody interested in NoSQL datastores the following presentation by Lorenzo Alberton is worth reading. It gives a good overview of the currently used technologies in the area of NoSQL and discusses the ground filling basics every NoSQL enthusiast should know.

NoSQL Databases: Why, what and when (via quipo)

NoSQL: Node.js + NoSQL Database => Real Time Chat Applications (themindstorms.blogspot.com)
NoSQL: The NoSQL Gene in SQL Azure Federations (themindstorms.blogspot.com)
NoSQL: Why startups should not choose NoSQL (themindstorms.blogspot.com)
The “Switzerland of NoSQL” Joins Basho (readwriteweb.com)
NoSQL Handbook (nosqlhandbook.com)

[video] – How is Hadoop used at Twitter?

Herbert Mühlburger — Fri, 10 Sep 2010 13:02:24 +0000

Image via CrunchBase

In the following video Dmitriy Ryaboy, a Twitter Analytics Engineer and a former Cloudera Intern, explains how Twitter uses Hadoop and Pig. Enjoy the video and have a good weekend!

How GE uses Hadoop to analyze big data (news.cnet.com)
How GE uses Hadoop to analyze big data (news.cnet.com)
Hadoop There it Was–Hadoop Summit June 2010 (developer.yahoo.net)
Whooping it up for Hadoop (ycorpblog.com)
Heard at the Hadoop Summit: Quotes and Sound Bites (developer.yahoo.net)

NOSQL Summer in Graz Kick-Off Meeting

Herbert Mühlburger — Wed, 21 Jul 2010 19:27:07 +0000

Today was the kick-off meeting of NOSQL Summer here in Graz, Austria.

A NOSQL Summer is a network of local reading groups, that will decipher & discuss NOSQL-related articles, from late June to early September 2010. Each group sets its own meeting pace (usually once a week or once every two weeks) and select which papers are up for discussion.

At every cycle, members read the selected paper at home and then meet up for an hour or so to discuss, debate and answer their own questions.

The paper then gets annotated and is published again on the NOSQL Summer website.

Four of our in the meantime already 12 local swimmers decided to join the first meeting and dived into interesting topics regarding NOSQL and distributed computing with fellow geeks. We were reading and discussing the article called “On Designing and Deploying Internet-Scale Services” (PDF) written by James Hamilton. Our discussion was first driven this article but soon also covered other topics:

Cloud computing and setups
Privacy issues regarding cloud storage
Social networks and privacy concerns
Complexity in hardware setups regarding cloud services
Hadoop and HBASE
Philosophical discussions on how current and past society deals with privacy specially in cloud contexts

There were a lot of different opinions and views on using internet-services and the cloud for storing and processing one’s own data. Do you prefer to keep your data in a cloud or do you prefer to host all of your data by your own? We did not find one common answer to these questions and I guess you either won’t find one. It was an interesting meeting with friends and I am already looking forward to the next one.

The next NOSQL Summer Meeting will be announced through the NOSQL Summer Website but I can already give you the date. It will take place on the 4th of August 2010, hosted at the campus of Graz University of Technology again.

If you are interested in NOSQL or distributed computing and distributed storage then just subscribe to the NOSQL Summer Group of Graz and we will keep you informed on the next paper to read and on the next interesting dates.

Articles you may find interesting too

Paper: On Designing and Deploying Internet-Scale Services (highscalability.com)
Cassandra: Predicting the Future of NoSQL (readwriteweb.com)
Structure 2010: The Future of SQL in the Cloud (gigaom.com)
Weekly Wrap-up: Old Spice Videos, TED Talks for Startups, the New Digg, And More… (readwriteweb.com)
NoSQL, Heroku, and You (heroku.com)
Disruptive Cloud Computing Startups At Under The Radar – NoSQL – Aspirin, Vicodin, and Vitamin (cloudave.com)
NoSQL Database CouchDB Turns 1.0 (readwriteweb.com)

[video] – HBase and Pig: The Hadoop Ecosystem at Twitter

Herbert Mühlburger — Fri, 25 Jun 2010 06:17:16 +0000

I have just found this very interesting video dealing with the implementation of HBase and Pig in combination with Hadoop at Twitter:

HBase Digest, March 2010 (sematext.com)
Cassandra+Hadoop (slideshare.net)
Hadoop, Hbase and Hive- Bay area Hadoop User Group (slideshare.net)

Twitter’s use of Cassandra, Hadoop, Pig and HBase for highly distributed Data Processing and Analysis

Herbert Mühlburger — Thu, 06 May 2010 19:43:45 +0000

Kevin Weil, Analytics Lead at Twitter recently gave a presentation on Twitter’s use of Cassandra, Pig and HBase. Specially interesting is how Twitter uses Hadoop and Pig in their data analysis process.

(via @kevinweil)

Another great presentation from Tobias Ivarsson gives an overview on NoSQL:

(via @thobe)

[video] – Rethink the Data Warehouse with Hadoop and Hive

Herbert Mühlburger — Thu, 12 Nov 2009 08:07:33 +0000

Here is a great video explaining how Facebook uses Hadoop and Hive to build Data Warehouses and analyse their huge ammount of data. Every day Facebook gets around 4TB+ of compressed data, which is amazing and also difficult to be analysed.

(via Cloudera)