Comments on: Hadoop, the future of web back ends

By: Kevin Chiu

Kevin Chiu — Thu, 26 Nov 2009 05:41:29 +0000

@Kevin C – I’m actually hoping that Hadoop will come out of large scale offline analysis and into the real-time world sometime.

@Son Nguyen – Nice observation. I do hope real time search will entice the Hadoopers to get a real time layer into the system.

By: Son Nguyen

Son Nguyen — Mon, 16 Nov 2009 16:00:54 +0000

Hadoop is definitely on the watch list as it matures. You also face similar complexity when dealing with Hadoop/Hbase/Hive/HDFS (like setting up, breaking things down into tasks). But for many many applications, MySQL (or RDBMS) ain’t going anywhere. I see smart companies use both for different portions of their operations. Unless Hadoop can do real-time, low latency yet in distributed farms effortlessly, there is no clear winner now, or ever. Maybe the trend on real-time search (Twitter, FB) might be able to speed this up.

By: Kevin C

Kevin C — Fri, 07 Aug 2009 14:05:34 +0000

Kevin — any progress with Django + Hadoop? My team here is doing some investigating as to changing platforms and a framework that can grow into Hadoop support is ideal. Thanks!

By: Kevin Chiu

Kevin Chiu — Thu, 02 Apr 2009 04:39:55 +0000

Hi Angus,

Currently, I’m wrestling with Django + AppEngine, but I will return to Django + Hadoop in the future.

By: angus

angus — Thu, 26 Mar 2009 16:37:44 +0000

Hi,
Did you get time to investigate the possibility of hooking Hadoop + Hbase up to Django ?

I’m currently building a small Hadoop cluster composed of Virtual Machines and plan to use Hbase for python db access. Thus I’m very interested in feedback w/ such usage of Hadoop. These days, lots of people look at django + couchdb but Hadoop is certainly more mature than couchdb.

Keep the good work