Marcel's World

Ingredients for Open Data Mining

Marcel Neuhäusler — Wed, 25 Aug 2010 02:05:12 +0000

Potential ingredients for a platform that could offer data mining for everyone on public data sets:

munched together with some Java and Erlang and touch-enabled via iPad ...

Lucene in Action 2nd Edition

Marcel Neuhäusler — Mon, 26 Jul 2010 02:25:57 +0000

Just bought the 2nd edition of Lucene in Action .. the first edition was already a good read, but this 2nd one is just brilliant .. contains more interesting use-cases and a ton of "Applied Lucene" info .. in desperate need of a week off to work thru it ..

Google Command Line Tools

Marcel Neuhäusler — Sat, 19 Jun 2010 18:50:08 +0000

"GoogleCL brings Google services to the command line."

Example: google docs edit --title "Shopping list" --editor vim

.. pretty geeky :-) ..

Gizzard

Marcel Neuhäusler — Sat, 12 Jun 2010 20:44:46 +0000

".. Gizzard is a middleware networking service that manages partitioning data across arbitrary backend datastores (e.g., SQL databases, Lucene, etc.). The partitioning rules are stored in a forwarding table that maps key ranges to partitions. Each partition manages its own replication through a declarative replication tree. Gizzard supports migrations (for example, elastically adding machines to the cluster) and gracefully handles failures. The system is made eventually consistent by requiring that all write-operations are idempotent AND commutative and as operations fail (because of, e.g., a network partition) they are retried at a later time." ..

.. built on/with Scala and Thrift ..

I am looking for new application and platform services

Marcel Neuhäusler — Sun, 16 May 2010 16:18:43 +0000

(Via All Things Distributed)

I am looking for new application and platform services: "The ecosystem of new application and platform services in the cloud is the future of application development. It will drive rapid innovation and we'll see a wealth of mobile, web and desktop applications arrive that we couldn't dream about a few years ago, and these building blocks are the enablers of that. These services will be delivered not only by new startups but also by enterprises looking to capitalize on their IP."

.. the comment section of that blog post contains a lot of interesting services ..

Apple is an Experience Company

Marcel Neuhäusler — Wed, 14 Apr 2010 00:47:17 +0000

Apple is an Experience Company: "..To that end Apple should exert as much control over the platform as they can so that they can keep the experience magical. If whiny developers don't want to work within those constraints and can't be bothered to (re)write their application on the platform Apple is providing, I have no problem with that; they're probably not writing an application that's magical anyhow."

.. excellent blog post .. (Via Andy's Blog.)

Notes on MongoDB

Marcel Neuhäusler — Sun, 11 Apr 2010 01:06:08 +0000

"For an article in a German magazine I've been researching MongoDB over the last week or so. While I didn't need a lot of the information I came across I collected some nicely distilled notes on some of its inner workings. You won't find information on how to get data out of or into MongoDB. The notes deal with the way MongoDB treats and handles your data, a high-low-level view if you will. I tried to keep them as objective as possible, but I added some commentary below."

.. nice summary about the inner-workings of MongoDB .. via paperplanes ..

Eventual Consistency

Marcel Neuhäusler — Sat, 27 Feb 2010 23:16:20 +0000

Two interesting blog posts I came across regarding "eventual consistency" and nosql databases.

Spyced: "Handling deletes in a distributed, eventually consistent system is a little tricky"

All Things Distributed: "Amazon SimpleDB has launched today with a new set of features giving the customer more control over which consistency and concurrency models to use in their database operations."

MagLev

Marcel Neuhäusler — Mon, 22 Feb 2010 17:35:23 +0000

Distributed Ruby with the MagLev VM

"GemStone team made a splash with MagLev at RailsConf '08 where they attracted a fair dose of attention from the attendees. Based on an existing GemStone/Smalltalk VM, it promised a lot of inherent advantages: 64-bit, JIT, years of VM optimizations, and built-in persistence and distribution layers. Since then the team has been making steady progress, which recently resulted in the announcement of the first public alpha."

.. deja-vue? .. or is the time finally here for those type of language-bound shared persistency layers? ..

My PCM System

Marcel Neuhäusler — Sun, 03 Jan 2010 00:00:52 +0000

I just finished the first release of my PCM (personal content management system). The system I built uses CouchDB, SimpleDB, and a few servlets written in Java to listen, store, aggregate, and publish all the content I produce on Twitter, delicious, NyTimes People, this blog, and other sites. The nice thing, I can still use the regular interface of all those sites to enter content, while in the background my system is gathering that content automatically. That content then gets stored twice, in a local database and in the "Amazon cloud". From where the content then gets published to the ticker page in my new blog: Neuhäusler Weekly.

.. and of course I already have a ton of ideas how I could improve the system :-) ..