Wednesday, July 23, 2014

Streaming mode for camel-splunk consumer

Apache Camel has a splunk connector.  However it has an issue, that it runs out of memory if result set is too large.  I fixed it by adding streaming support. 

Here is the patch for streaming mode:
https://github.com/dmitrimedvedev/camel/commit/7e4b5e9b206c7a969e6012d9afa40ac7024ee515
https://github.com/dmitrimedvedev/camel/commit/f7063f760f5abf867fa2a6bbbd187220c941fa00

Tracked on ASF jira

Tuesday, July 08, 2014

Comparison of NoSQL systems

Here is an interesting spreadsheet comparing NoSQL systems:

Source:
University of Washington
Introduction to Data Science
https://class.coursera.org/datasci-001

Next trendy open source projects

If past is any indication of future trends, surely next trendy open source projects will be what's currently developed at technology leaders like google.  Similar to hadoop becoming popular after google published its map-reduce paper, and then big table implemented as hbase by open source community, surely there is a cool factor as well as value and following in building open source implementations of:
  • tenzing
  • dremel
  • pregel
  • megastore
  • spanner

Thursday, July 03, 2014

Bash trick to reference all args from previous command

!!:1- is a nice shortcut for referencing all arguments from the previous bash command.

command                equivalent
---------------------------------------
ls                           
sudo !!                    sudo ls
!$                            ls
ls 1.txt 2.txt           
ls !$                        ls 2.txt
ls 1.txt 2.txt           
cat !!:1-                  cat 1.txt 2.txt  

Wednesday, July 02, 2014

NoSQL databases and CAP theorem

CAP theorem claims that it's possible to achieve only two of the three in a distributed system:
  • consistency
  • availability
  • partition tolerance (# of nodes)
How do NoSQL databases stand on this?  There is a nice illustration from Shashank Tiwari: