NoSQL Demo Materials

Copyright (c) 2013 Tatsuya Kawano, Cloudian Inc. & KK

@TODO: Translate this document into Japanese.

This seminar material contains the followings:

• MongoDB

  • Ruby client
  • JavaScript Map Reduce

• Cassandra

  • CQL3
  • Ruby client (CQL3)

• VoltDB

  • sqlcmd (for ad-hoc queries) and csvloader

Hopefully, I'll have more time to add the followings in the future:

• Redis

  • Ruby client

• Infinispan

  • Scala client

• VoltDB

  • Java stored procedures
  • Scala client

• Neo4J

  • Ruby client (See the references in an old [https://github.com/tatsuya6502/nosql-ja/blob/325552e2f5/neo4j-ruby/README.md](neo4j-ruby README at #325552e2f5) ). I found neography works great.

Preparation

• Fedora 19 x86_64

In the future, I'll use followings to demonstrate multi node deployment.

• SmartOS with Solaris Zones (on HP MicroServer)
• Arch Linux x86_64 with Docker CentOS containers (on Mac mini)

Installation (Fedora 19)

@TODO: Use Chef Solo to automate this process.

Enable Remote Login (sshd)

@TODO: (System Settings)

Install Dev Tools

$ sudo yum groupinstall "Development Tools"

Install Oracle JDK

• Version 1.7.0_25
• sudo alternatives java
• sudo alternatives javac

Install Scala (Optional)

• Version 2.10.2
• http://www.scala-lang.org/downloads/distrib/files/scala-2.10.2.tgz

$ mkdir ~/opt
$ ...

Install Ruby via rvm

• Version 2.0.0p247

Create .gemrc (Optional)

If you're PC is in China, you won't be able to access the primary Ruby-Gem repository. You'll need to use a mirror site in China. Create ~/.gemrc file and put the following contents:

---
:sources:
- http://gems.gzruby.org/
gem: --no-rdoc --no-ri

Install rvm

$ curl -L https://get.rvm.io | bash -s stable
$ source $HOME/.rvm/scripts/rvm

If you have rvm already installed, make sure to bring it up to the latest stable version.

$ source $HOME/.rvm/scripts/rvm
$ rvm get stable
$ rvm reload

Install Ruby 2.0

$ rvm list known
$ rvm install 2.0.0
$ rvm alias create default 2.0.0
$ rvm list
rvm rubies

=* ruby-2.0.0-p247 [ x86_64 ]

# => - current
# =* - current && default
#  * - default

$ ruby --version
ruby 2.0.0p247 (2013-06-27 revision 41674) [x86_64-linux]

Add source $HOME/.rvm/scripts/rvm to your shell rc file (e.g. .bashrc)

Troubleshooting

If you get the following error while installing Ruby, you need to manually set the latest version of Ruby Gem.

There was an error while trying to resolve rubygems version for 'latest'

Go to http://github.com/rubygems/rubygems/tags and find out the latest version. Then open ~/.rvm/config/db with an editor and set the ruby_2.0.0_rubygem_version to the latest version.

For example,

ruby_2.0.0_rubygems_version=2.0.5

Install MongoDB

• Version 2.4.5
• http://www.mongodb.org/downloads
• http://fastdl.mongodb.org/linux/mongodb-linux-x86_64-2.4.5.tgz
• http://docs.mongodb.org/manual/MongoDB-manual.pdf

Install Cassandra

• Version 1.2.6
• http://cassandra.apache.org/download/
• OR use yum from DataStax:
  • [DataStax Installing Cassandra](http://www.datastax.com/documentation/gettingstarted/index.html?pagename=docs&version=quick_start&file=quickstart#!_Installing Cassandra)

Install VoltDB

• Version 3.4
• Download the binary from the download page. (You'll be asked to subscribe mail news.)
• OR clone VoltDB repository from GitHub and build it by yourself. (You'll need ant installed.)

Install Neo4J (Optional)

• Version 1.9.2
• http://www.neo4j.org/download_thanks?edition=community&release=1.9.2&platform=unix

Install Redis (Optional)

• Version 2.6.14
• http://redis.io/download
• http://redis.io/topics/quickstart

Download, extract and compile Redis with:

$ sudo yum install jemalloc
$ wget http://redis.googlecode.com/files/redis-2.6.14.tar.gz
$ tar xzf redis-2.6.14.tar.gz
$ cd redis-2.6.14
$ make distclean
$ make

The binaries that are now compiled are available in the src directory. Run Redis with:

$ src/redis-server

You can interact with Redis using the built-in client:

$ src/redis-cli
redis> set foo bar
OK
redis> get foo
"bar"

Install Infinispan (Optional)

• Version 5.3.0
• http://www.jboss.org/infinispan/downloads.html
• Roadmap: https://community.jboss.org/wiki/InfinispanRoadmap
• https://docs.jboss.org/author/display/ISPN/Infinispan+with+Scala

Download Movie Lens Dataset

• http://www.grouplens.org/node/73
• There are three data sets with 100K, 1M and 10M rating records, get ones you want.

License

The MIT License (MIT)

Copyright (c) 2013 Tatsuya Kawano, Cloudian Inc. & KK

(en)

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

(ja)

以下に定める条件に従い、本ソフトウェアおよび関連文書のファイル（以下 「ソフトウェア」）の複製を取得するすべての人に対し、ソフトウェアを無制 限に扱うことを無償で許可します。これには、ソフトウェアの複製を使用、複 写、変更、結合、掲載、頒布、サブライセンス、および/または販売する権利、 およびソフトウェアを提供する相手に同じことを許可する権利も無制限に含ま れます。

上記の著作権表示および本許諾表示を、ソフトウェアのすべての複製または重 要な部分に記載するものとします。

ソフトウェアは「現状のまま」で、明示であるか暗黙であるかを問わず、何ら の保証もなく提供されます。ここでいう保証とは、商品性、特定の目的への適 合性、および権利非侵害についての保証も含みますが、それに限定されるもの ではありません。 作者または著作権者は、契約行為、不法行為、またはそれ 以外であろうと、ソフトウェアに起因または関連し、あるいはソフトウェアの 使用またはその他の扱いによって生じる一切の請求、損害、その他の義務につ いて何らの責任も負わないものとします。