run hadoop on aws ec2 by yourself.

$/usr/bin/hadoop namenode -format 11/12/31 06:28:39 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = ip-10-146-3-18.ap-northeast-1.compute.internal/10.146.3.18 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 0.20.2-cdh3u2 STARTUP_MSG: build = file:///tmp/topdir/BUILD/hadoop-0.20.2-cdh3u2 -r 95a824e4005b2a94fe1c11f1ef9db4c672ba43cb; compiled by 'root' on Thu Oct 13 21:51:41 PDT 2011 ************************************************************/ 11/12/31 06:28:39 INFO util.GSet: VM type = 32-bit 11/12/31 06:28:39 INFO util.GSet: 2% max memory = 19.33375 MB 11/12/31 06:28:39 INFO util.GSet: capacity = 2^22 = 4194304 entries 11/12/31 06:28:39 INFO util.GSet: recommended=4194304, actual=4194304 11/12/31 06:28:40 INFO namenode.FSNamesystem: fsOwner=hduser 11/12/31 06:28:40 INFO namenode.FSNamesystem: supergroup=supergroup 11/12/31 06:28:40 INFO namenode.FSNamesystem: isPermissionEnabled=true 11/12/31 06:28:40 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=1000 11/12/31 06:28:40 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s) 11/12/31 06:28:40 INFO common.Storage: Image file of size 112 saved in 0 seconds. 11/12/31 06:28:40 INFO common.Storage: Storage directory /tmp/hadoop-hduser/dfs/name has been successfully formatted. 11/12/31 06:28:40 INFO namenode.NameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down NameNode at ip-10-146-3-18.ap-northeast-1.compute.internal/10.146.3.18 ************************************************************/ Refer to http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/

install Hadoop 0.20 to your AWS EC2 (CentOS)

$cd /etc/yum.repos.d $sudo wget http://archive.cloudera.com/redhat/cdh/cloudera-cdh3.repo $sudo yum update yum $sudo yum search hadoop $sudo yum install hadoop-0.20

change your default git editor to vi

git config --global core.editor vi

start using git

$ sudo apt-get install git-core $ git config –global user.name “YOUR NAME” $ git config –global user.email “YOUR EMAIL” $ git config –list want to install Grails, Groov on Ununtu 11.04

install rvm on CentOS for aws ec2

$ bash < <(curl -sk https://raw.github.com/wayneeseguin/rvm/master/binscripts/rvm-installer)

$ echo '[[ -s "$HOME/.rvm/scripts/rvm" ]] && . "$HOME/.rvm/scripts/rvm" # Load RVM function' >> ~/.bash_profile

$ source ~/.bash_profile

$ yum install -y gcc-c++ patch readline readline-devel zlib zlib-devel libyaml-devel libffi-devel openssl-devel make bzip2 autoconf automake libtool bison
888 sudo yum install -y gcc-c++ patch readline readline-devel zlib zlib-devel libyaml-devel libffi-devel openssl-devel make bzip2 autoconf automake libtool bison

$ $ rvm list known
# MRI Rubies
[ruby-]1.8.6[-p420]
[ruby-]1.8.6-head
[ruby-]1.8.7[-p352]
[ruby-]1.8.7-head
[ruby-]1.9.1-p378
[ruby-]1.9.1[-p431]
[ruby-]1.9.1-head
[ruby-]1.9.2-p180
[ruby-]1.9.2[-p290]
[ruby-]1.9.2-head
[ruby-]1.9.3-preview1
[ruby-]1.9.3-rc1
[ruby-]1.9.3[-p0]
[ruby-]1.9.3-head
ruby-head

# GoRuby
goruby

# JRuby
jruby-1.2.0
jruby-1.3.1
jruby-1.4.0
jruby-1.6.1
jruby-1.6.2
jruby-1.6.3
jruby-1.6.4
jruby[-1.6.5]
jruby-head

# Rubinius
rbx-1.0.1
rbx-1.1.1
rbx-1.2.3
rbx-1.2.4
rbx[-head]
rbx-2.0.0pre

# Ruby Enterprise Edition
ree-1.8.6
ree[-1.8.7][-2011.03]
ree-1.8.6-head
ree-1.8.7-head

# Kiji
kiji

# MagLev
maglev[-head]
maglev-1.0.0

# Mac OS X Snow Leopard Only
macruby[-0.10]
macruby-nightly
macruby-head

# IronRuby -- Not implemented yet.
ironruby-0.9.3
ironruby-1.0-rc2
ironruby-head

http://beginrescueend.com/rvm/install/

How to solve this problem: curl: (7) couldn't connect to host for cuuchDB

if you configure couchdb for CentOS.
please refer to http://opikanoba.org/linux/couchdb-centos6

if you ok for curl http://localhost:5984 but not for curl http://domainName:5984

change your bind IP in local.ini as follows

$ sudo vi /usr/local/etc/couchdb/local.ini

change bind 127.0.0.1 to  bind 0.0.0.0