前言 hadoop是分布式文件系统，运行在linux之上，配置起来相对复杂。对于hadoop1，很多同学就因为不能搭建正确的运行环境，导致学习兴趣锐减。不过，我有免费的学习视频，请点击这里。 hadoop2出来后，解决了hadoop1的几个固有缺陷，比如单点故障、资源利用
前言hadoop是分布式文件系统，运行在linux之上，配置起来相对复杂。对于hadoop1，很多同学就因为不能搭建正确的运行环境，导致学习兴趣锐减。不过，我有免费的学习视频，请点击这里。
hadoop2出来后，解决了hadoop1的几个固有缺陷，比如单点故障、资源利用率低、支持作业类型少等问题，结构发生了很大变化，是hadoop未来使用的一个趋势。当然配置也更加复杂，网上也没有一篇详细的教程来知指导大家可以轻轻松松搭建这个环境的。我应该算是第一个吧。
hadoop2的体系结构要想理解本节内容，首先需要了解hadoop1的体系结构。在本博客中和我的视频中都有相关的内容，这里不再重复，只讲hadoop2的内容。
hadoop1的核心组成是两部分，即hdfs和mapreduce。在hadoop2中变为hdfs和yarn。
新的hdfs中的namenode不再是只有一个了，可以有多个(目前只支持两个)。每一个都有相同的职能。
问：这两个namenode的地位如何呢？
答：一个是active状态的，一个是standby状态的。当集群运行时，只有一个active状态的namenode是正常工作的，standby状态的namenode是处于待命状态的，时刻同步active状态namenode的数据。一旦active状态的namenode不能正常工作，通过手工或者自动切换，standby状态的namenode就可以转变为active状态的，就可以继续工作了。这就是高可靠。
问：当namenode发生故障时，他们的数据如何保持一致哪？
答：在这里，2个namenode的数据其实是实时共享的。新hdfs采用了一种共享机制，journalnode集群或者nfs进行共享。nfs是操作系统层面的，journalnode是hadoop层面的，我们这里使用journalnode集群进行数据共享。
问：如何是实现namenode自动切换呢？
答：这就需要使用zookeeper集群进行选择了。hdfs集群中的两个namenode都在zookeeper中注册，当active状态的namenode出现故障时，zookeeper能检测到这种情况，它就会自动把standby状态的namenode切换为active状态。
问：hdfs federation(hdfs联盟)是怎么回事呢？
答：联盟的出现是有原因的。我们知道namenode是核心节点，维护着整个hdfs的元数据信息，namenode其容量是有限的，受制于服务器的内存空间。当namenode服务器的内存装不下数据后，那么hdfs集群就装不下数据了，寿命也就到头了。因此其扩展性也是受限的，hdfs联盟指的是有多个hdfs集群同时工作，那么其容量理论上就不受限了，夸张点说就是无限扩展。
配置过程详解大家从官网下载的apache hadoop2.2.0的代码是32位操作系统下编译的，不能使用64位的jdk。我下面部署的hadoop代码是自己的64位机器上重新编译过的。服务器都是64位的，本配置尽量模拟真实环境。大家可以以32位的操作系统做练习，这是没关系的。关于基本环境的详细配置，大家可以观看我的视频，或者浏览吴超沉思录
在这里我们选用4台进行示范，各台机器的职责如下表格所示
配置文件一共包括6个，分别是hadoop-env.sh、core-sie.xml、hdfs-site.xml、mapred-site.xml、yarn-site.xml和slaves。除了hdfs-site.xml文件在不同集群配置不同外，其余文件在四个节点的配置是完全一样的，可以复制。
文件hadoop-env.sh就是修改这一行内容，修改后的结构如下：
export java_home=/usr/local/jdk
注：这里的java_home的值是jdk的安装路径。如果你那里不一样，请修改为自己的地址。
文件core-site.xmlfs.defaultfshdfs://cluster1【这里的值指的是默认的hdfs路径。当有多个hdfs集群同时工作时，用户如果不写集群名称，那么默认使用哪个哪？在这里指定！该值来自于hdfs-site.xml中的配置】 hadoop.tmp.dir/usr/local/hadoop/tmp【这里的路径默认是namenode、datanode、journalnode等存放数据的公共目录。用户也可以自己单独指定这三类节点的目录。】 ha.zookeeper.quorumhadoop101:2181,hadoop102:2181,hadoop103:2181【这里是zookeeper集群的地址和端口。注意，数量一定是奇数，且不少于三个节点】
集群c1的文件hdfs-site.xml该文件只配置在hadoop101和hadoop102上。
dfs.replication2【指定datanode存储block的副本数量。默认值是3个，我们现在有4个datanode，该值不大于4即可。】 dfs.nameservicescluster1,cluster2【使用federation时，使用了2个hdfs集群。这里抽象出两个nameservice实际上就是给这2个hdfs集群起了个别名。名字可以随便起，相互不重复即可】 dfs.ha.namenodes.cluster1hadoop101,hadoop102【指定nameservice是cluster1时的namenode有哪些，这里的值也是逻辑名称，名字随便起，相互不重复即可】 dfs.namenode.rpc-address.cluster1.hadoop101hadoop101:9000【指定hadoop101的rpc地址】 dfs.namenode.http-address.cluster1.hadoop101hadoop101:50070【指定hadoop101的http地址】 dfs.namenode.rpc-address.cluster1.hadoop102hadoop102:9000【指定hadoop102的rpc地址】dfs.namenode.http-address.cluster1.hadoop102hadoop102:50070【指定hadoop102的http地址】 dfs.namenode.shared.edits.dirqjournal://hadoop101:8485;hadoop102:8485;hadoop103:8485/cluster1 【指定cluster1的两个namenode共享edits文件目录时，使用的journalnode集群信息】dfs.ha.automatic-failover.enabled.cluster1true 【指定cluster1是否启动自动故障恢复，即当namenode出故障时，是否自动切换到另一台namenode】dfs.client.failover.proxy.provider.cluster1org.apache.hadoop.hdfs.server.namenode.ha.configuredfailoverproxyprovider【指定cluster1出故障时，哪个实现类负责执行故障切换】 dfs.ha.namenodes.cluster2hadoop103,hadoop104【指定nameservice是cluster2时，两个namenode是谁，这里是逻辑名称，不重复即可。以下配置与cluster1几乎全部相似，不再添加注释】 dfs.namenode.rpc-address.cluster2.hadoop103hadoop103:9000dfs.namenode.http-address.cluster2.hadoop103hadoop103:50070dfs.namenode.rpc-address.cluster2.hadoop104hadoop104:9000dfs.namenode.http-address.cluster2.hadoop104hadoop104:50070dfs.ha.automatic-failover.enabled.cluster2truedfs.client.failover.proxy.provider.cluster2org.apache.hadoop.hdfs.server.namenode.ha.configuredfailoverproxyproviderdfs.journalnode.edits.dir/usr/local/hadoop/tmp/journal【指定journalnode集群在对namenode的目录进行共享时，自己存储数据的磁盘路径】 dfs.ha.fencing.methodssshfence【一旦需要namenode切换，使用ssh方式进行操作】 dfs.ha.fencing.ssh.private-key-files/root/.ssh/id_rsa【如果使用ssh进行故障切换，使用ssh通信时用的密钥存储的位置】
集群c2的文件hdfs-site.xml该文件只配置在hadoop103和hadoop104上。
该文件与c1中的hdfs-site.xml配置内容完全相同，只有注释位置不一样，一定要注意，不要随便改。
dfs.replication2dfs.nameservicescluster1,cluster2dfs.ha.namenodes.cluster1hadoop101,hadoop102dfs.namenode.rpc-address.cluster1.hadoop101hadoop101:9000dfs.namenode.http-address.cluster1.hadoop101hadoop101:50070dfs.namenode.rpc-address.cluster1.hadoop102hadoop102:9000dfs.namenode.http-address.cluster1.hadoop102hadoop102:50070dfs.ha.automatic-failover.enabled.cluster1truedfs.client.failover.proxy.provider.cluster1org.apache.hadoop.hdfs.server.namenode.ha.configuredfailoverproxyproviderdfs.ha.namenodes.cluster2hadoop103,hadoop104dfs.namenode.rpc-address.cluster2.hadoop103hadoop103:9000dfs.namenode.http-address.cluster2.hadoop103hadoop103:50070dfs.namenode.rpc-address.cluster2.hadoop104hadoop104:9000dfs.namenode.http-address.cluster2.hadoop104hadoop104:50070dfs.namenode.shared.edits.dirqjournal://hadoop101:8485;hadoop102:8485;hadoop103:8485/cluster2dfs.ha.automatic-failover.enabled.cluster2truedfs.client.failover.proxy.provider.cluster2org.apache.hadoop.hdfs.server.namenode.ha.configuredfailoverproxyproviderdfs.journalnode.edits.dir/usr/local/hadoop/tmp/journaldfs.ha.fencing.methodssshfencedfs.ha.fencing.ssh.private-key-files/root/.ssh/id_rsa
文件mapred-site.xmlmapreduce.framework.nameyarn【指定运行mapreduce的环境是yarn，与hadoop1截然不同的地方】
文件yarn-site.xmlyarn.resourcemanager.hostnamehadoop101【自定resourcemanager的地址，还是单点，这是隐患】yarn.nodemanager.aux-servicesmapreduce_shuffle
文件slaveshadoop101 hadoop102 hadoop103 hadoop104【指定所有的datanode节点列表，每行一个节点名称】
特别注意：以上配置中c1中的hdfs-site.xml文件配置在hadoop101和hadoop102中，c2的hdfs-site.xml文件在hadoop103和hadoop104中。其余文件在各个节点都相同。
启动过程启动时，要非常小心，请严格按照我这里描述的步骤做，每一步要检查自己的操作是否正确。
1.首先检查各个结点的配置文件是否正确郑重声明：特别要注意hdfs-site.xml文件，在c1和c2中是不同的。
2.启动zookeeper集群关于zookeeper的集群配置和启动描述见，这里不再详述。
在hadoop101、hadoop102、hadoop103上分别执行命令：zkserver.sh start
命令输出(以hadoop101为例)：
[root@hadoop101 hadoop]# zkserver.sh status jmx enabled by default using config: /usr/local/zookeeper/bin/../conf/zoo.cfg mode: follower
三个节点都执行完成启动命令后，在hadoop101执行以下验证。验证：
[root@hadoop101 hadoop]# zkcli.sh connecting to localhost:2181 2014-02-12 07:20:35,509 [myid:] - info [main:environment@100] - client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 gmt 2014-02-12 07:20:35,523 [myid:] - info [main:environment@100] - client environment:host.name=hadoop101 2014-02-12 07:20:35,524 [myid:] - info [main:environment@100] - client environment:java.version=1.7.0_45 2014-02-12 07:20:35,525 [myid:] - info [main:environment@100] - client environment:java.vendor=oracle corporation 2014-02-12 07:20:35,525 [myid:] - info [main:environment@100] - client environment:java.home=/usr/local/jdk/jre 2014-02-12 07:20:35,526 [myid:] - info [main:environment@100] - client environment:java.class.path=/usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/*.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.2.2.final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.15.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.5.jar:/usr/local/zookeeper/bin/../src/java/lib/*.jar:/usr/local/zookeeper/bin/../conf:/usr/local/hadoop 2014-02-12 07:20:35,526 [myid:] - info [main:environment@100] - client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2014-02-12 07:20:35,527 [myid:] - info [main:environment@100] - client environment:java.io.tmpdir=/tmp 2014-02-12 07:20:35,528 [myid:] - info [main:environment@100] - client environment:java.compiler= 2014-02-12 07:20:35,528 [myid:] - info [main:environment@100] - client environment:os.name=linux 2014-02-12 07:20:35,529 [myid:] - info [main:environment@100] - client environment:os.arch=amd64 2014-02-12 07:20:35,529 [myid:] - info [main:environment@100] - client environment:os.version=2.6.32-431.el6.x86_64 2014-02-12 07:20:35,530 [myid:] - info [main:environment@100] - client environment:user.name=root 2014-02-12 07:20:35,530 [myid:] - info [main:environment@100] - client environment:user.home=/root 2014-02-12 07:20:35,531 [myid:] - info [main:environment@100] - client environment:user.dir=/usr/local/hadoop 2014-02-12 07:20:35,533 [myid:] - info [main:zookeeper@438] - initiating client connection, connectstring=localhost:2181 sessiontimeout=30000 watcher=org.apache.zookeeper.zookeepermain$mywatcher@10636a7e welcome to zookeeper! 2014-02-12 07:20:35,569 [myid:] - info [main-sendthread(127.0.0.1:2181):clientcnxn$sendthread@966] - opening socket connection to server 127.0.0.1/127.0.0.1:2181. will not attempt to authenticate using sasl (unknown error) 2014-02-12 07:20:35,587 [myid:] - info [main-sendthread(127.0.0.1:2181):clientcnxn$sendthread@849] - socket connection established to 127.0.0.1/127.0.0.1:2181, initiating session jline support is enabled 2014-02-12 07:20:35,687 [myid:] - info [main-sendthread(127.0.0.1:2181):clientcnxn$sendthread@1207] - session establishment complete on server 127.0.0.1/127.0.0.1:2181, sessionid = 0x654423404e530000, negotiated timeout = 30000watcher::watchedevent state:syncconnected type:none path:null [zk: localhost:2181(connected) 0] ls / [zookeeper] [zk: localhost:2181(connected) 1]
注：可以看到zk集群中只有一个节点zookeeper。
3.格式化zookeeper集群，目的是在zookeeper集群上建立ha相应节点。在hadoop101上执行命令：/usr/local/hadoop/bin/hdfs/hdfs zkfc -formatzk
命令输出：
[root@hadoop101 hadoop]# /usr/local/hadoop/bin/hdfs zkfc -formatzk 14/02/12 07:28:56 info tools.dfszkfailovercontroller: failover controller configured for namenode namenode at hadoop101/192.168.80.101:9000 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 gmt 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:host.name=hadoop101 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:java.version=1.7.0_45 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:java.vendor=oracle corporation 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:java.home=/usr/local/jdk/jre 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:java.class.path=/usr/local/hadoop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-el-1.0.jar:/usr/local/hadoop/share/hadoop/common/lib/jets3t-0.6.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/usr/local/hadoop/share/hadoop/common/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-lang-2.5.jar:/usr/local/hadoop/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-annotations-2.2.0.jar:/usr/local/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/usr/local/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop/share/hadoop/common/lib/zookeeper-3.4.5.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-auth-2.2.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/common/lib/stax-api-1.0.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/common/lib/junit-4.8.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/jsr305-1.3.9.jar:/usr/local/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-logging-1.1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-math-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/usr/local/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/usr/local/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/usr/local/hadoop/share/hadoop/common/hadoop-common-2.2.0-tests.jar:/usr/local/hadoop/share/hadoop/common/hadoop-common-2.2.0.jar:/usr/local/hadoop/share/hadoop/common/hadoop-nfs-2.2.0.jar:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-el-1.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.2.0.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.2.0-tests.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/hamcrest-core-1.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/junit-4.10.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/junit-4.10.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/usr/local/hadoop/contrib/capacity-scheduler/*.jar 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:java.library.path=/usr/local/hadoop/lib/native 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:java.io.tmpdir=/tmp 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:java.compiler= 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:os.name=linux 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:os.arch=amd64 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:os.version=2.6.32-431.el6.x86_64 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:user.name=root 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:user.home=/root 14/02/12 07:28:57 info zookeeper.zookeeper: client environment:user.dir=/usr/local/hadoop 14/02/12 07:28:57 info zookeeper.zookeeper: initiating client connection, connectstring=hadoop101:2181,hadoop102:2181,hadoop103:2181 sessiontimeout=5000 watcher=org.apache.hadoop.ha.activestandbyelector$watcherwithclientref@3e9c00ea 14/02/12 07:28:57 info zookeeper.clientcnxn: opening socket connection to server hadoop102/192.168.80.102:2181. will not attempt to authenticate using sasl (unknown error) 14/02/12 07:28:57 info zookeeper.clientcnxn: socket connection established to hadoop102/192.168.80.102:2181, initiating session 14/02/12 07:28:57 info zookeeper.clientcnxn: session establishment complete on server hadoop102/192.168.80.102:2181, sessionid = 0x6644234039710000, negotiated timeout = 5000 14/02/12 07:28:57 info ha.activestandbyelector: session connected. 14/02/12 07:28:57 info ha.activestandbyelector: successfully created /hadoop-ha/cluster1 in zk. 14/02/12 07:28:57 info zookeeper.zookeeper: session: 0x6644234039710000 closed 14/02/12 07:28:57 info zookeeper.clientcnxn: eventthread shut down [root@hadoop101 hadoop]#
验证：[root@hadoop101 hadoop]# zkcli.sh connecting to localhost:2181 2014-02-12 07:30:24,355 [myid:] - info [main:environment@100] - client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 gmt 2014-02-12 07:30:24,373 [myid:] - info [main:environment@100] - client environment:host.name=hadoop101 2014-02-12 07:30:24,374 [myid:] - info [main:environment@100] - client environment:java.version=1.7.0_45 2014-02-12 07:30:24,375 [myid:] - info [main:environment@100] - client environment:java.vendor=oracle corporation 2014-02-12 07:30:24,376 [myid:] - info [main:environment@100] - client environment:java.home=/usr/local/jdk/jre 2014-02-12 07:30:24,376 [myid:] - info [main:environment@100] - client environment:java.class.path=/usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/*.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.2.2.final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.15.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.5.jar:/usr/local/zookeeper/bin/../src/java/lib/*.jar:/usr/local/zookeeper/bin/../conf:/usr/local/hadoop 2014-02-12 07:30:24,378 [myid:] - info [main:environment@100] - client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2014-02-12 07:30:24,379 [myid:] - info [main:environment@100] - client environment:java.io.tmpdir=/tmp 2014-02-12 07:30:24,380 [myid:] - info [main:environment@100] - client environment:java.compiler= 2014-02-12 07:30:24,381 [myid:] - info [main:environment@100] - client environment:os.name=linux 2014-02-12 07:30:24,382 [myid:] - info [main:environment@100] - client environment:os.arch=amd64 2014-02-12 07:30:24,382 [myid:] - info [main:environment@100] - client environment:os.version=2.6.32-431.el6.x86_64 2014-02-12 07:30:24,383 [myid:] - info [main:environment@100] - client environment:user.name=root 2014-02-12 07:30:24,383 [myid:] - info [main:environment@100] - client environment:user.home=/root 2014-02-12 07:30:24,384 [myid:] - info [main:environment@100] - client environment:user.dir=/usr/local/hadoop 2014-02-12 07:30:24,387 [myid:] - info [main:zookeeper@438] - initiating client connection, connectstring=localhost:2181 sessiontimeout=30000 watcher=org.apache.zookeeper.zookeepermain$mywatcher@10636a7e welcome to zookeeper! 2014-02-12 07:30:24,422 [myid:] - info [main-sendthread(127.0.0.1:2181):clientcnxn$sendthread@966] - opening socket connection to server 127.0.0.1/127.0.0.1:2181. will not attempt to authenticate using sasl (unknown error) 2014-02-12 07:30:24,462 [myid:] - info [main-sendthread(127.0.0.1:2181):clientcnxn$sendthread@849] - socket connection established to 127.0.0.1/127.0.0.1:2181, initiating session jline support is enabled 2014-02-12 07:30:24,494 [myid:] - info [main-sendthread(127.0.0.1:2181):clientcnxn$sendthread@1207] - session establishment complete on server 127.0.0.1/127.0.0.1:2181, sessionid = 0x654423404e530001, negotiated timeout = 30000watcher::watchedevent state:syncconnected type:none path:null [zk: localhost:2181(connected) 0] ls / [hadoop-ha, zookeeper] [zk: localhost:2181(connected) 1] ls /hadoop-ha [cluster1] [zk: localhost:2181(connected) 2]
注：格式化操作的目的是在zk集群中建立一个节点，用于保存集群c1中namenode的状态数据。在hadoop103上执行命令：/usr/local/hadoop/bin/hdfs zkfc -formatzk
命令输出：
[root@hadoop103 hadoop]# /usr/local/hadoop/bin/hdfs zkfc -formatzk 14/02/12 07:32:14 warn util.nativecodeloader: unable to load native-hadoop library for your platform... using builtin-java classes where applicable 14/02/12 07:32:14 info tools.dfszkfailovercontroller: failover controller configured for namenode namenode at hadoop103/192.168.80.103:9000 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 gmt 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:host.name=hadoop103 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:java.version=1.7.0_45 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:java.vendor=oracle corporation 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:java.home=/usr/local/jdk/jre 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:java.class.path=/usr/local/hadoop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-el-1.0.jar:/usr/local/hadoop/share/hadoop/common/lib/jets3t-0.6.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/usr/local/hadoop/share/hadoop/common/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-lang-2.5.jar:/usr/local/hadoop/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-annotations-2.2.0.jar:/usr/local/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/usr/local/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop/share/hadoop/common/lib/zookeeper-3.4.5.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-auth-2.2.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/common/lib/stax-api-1.0.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/common/lib/junit-4.8.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/jsr305-1.3.9.jar:/usr/local/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-logging-1.1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-math-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/usr/local/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/usr/local/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/usr/local/hadoop/share/hadoop/common/hadoop-common-2.2.0-tests.jar:/usr/local/hadoop/share/hadoop/common/hadoop-common-2.2.0.jar:/usr/local/hadoop/share/hadoop/common/hadoop-nfs-2.2.0.jar:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-el-1.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.2.0.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.2.0-tests.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/hamcrest-core-1.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/junit-4.10.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/junit-4.10.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/usr/local/hadoop/contrib/capacity-scheduler/*.jar 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:java.io.tmpdir=/tmp 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:java.compiler= 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:os.name=linux 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:os.arch=amd64 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:os.version=2.6.32-431.el6.x86_64 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:user.name=root 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:user.home=/root 14/02/12 07:32:14 info zookeeper.zookeeper: client environment:user.dir=/usr/local/hadoop 14/02/12 07:32:14 info zookeeper.zookeeper: initiating client connection, connectstring=hadoop101:2181,hadoop102:2181,hadoop103:2181 sessiontimeout=5000 watcher=org.apache.hadoop.ha.activestandbyelector$watcherwithclientref@91d3b18 14/02/12 07:32:14 info zookeeper.clientcnxn: opening socket connection to server hadoop102/192.168.80.102:2181. will not attempt to authenticate using sasl (unknown error) 14/02/12 07:32:14 info zookeeper.clientcnxn: socket connection established to hadoop102/192.168.80.102:2181, initiating session 14/02/12 07:32:14 info zookeeper.clientcnxn: session establishment complete on server hadoop102/192.168.80.102:2181, sessionid = 0x6644234039710001, negotiated timeout = 5000 14/02/12 07:32:14 info ha.activestandbyelector: session connected. 14/02/12 07:32:14 info ha.activestandbyelector: successfully created /hadoop-ha/cluster2 in zk. 14/02/12 07:32:14 info zookeeper.zookeeper: session: 0x6644234039710001 closed 14/02/12 07:32:14 info zookeeper.clientcnxn: eventthread shut down
验证：[root@hadoop103 hadoop]# zkcli.sh connecting to localhost:2181 2014-02-12 07:32:21,770 [myid:] - info [main:environment@100] - client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 gmt 2014-02-12 07:32:21,786 [myid:] - info [main:environment@100] - client environment:host.name=hadoop103 2014-02-12 07:32:21,788 [myid:] - info [main:environment@100] - client environment:java.version=1.7.0_45 2014-02-12 07:32:21,789 [myid:] - info [main:environment@100] - client environment:java.vendor=oracle corporation 2014-02-12 07:32:21,789 [myid:] - info [main:environment@100] - client environment:java.home=/usr/local/jdk/jre 2014-02-12 07:32:21,790 [myid:] - info [main:environment@100] - client environment:java.class.path=/usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/*.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.2.2.final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.15.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.5.jar:/usr/local/zookeeper/bin/../src/java/lib/*.jar:/usr/local/zookeeper/bin/../conf:/usr/local/hadoop 2014-02-12 07:32:21,791 [myid:] - info [main:environment@100] - client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2014-02-12 07:32:21,792 [myid:] - info [main:environment@100] - client environment:java.io.tmpdir=/tmp 2014-02-12 07:32:21,793 [myid:] - info [main:environment@100] - client environment:java.compiler= 2014-02-12 07:32:21,793 [myid:] - info [main:environment@100] - client environment:os.name=linux 2014-02-12 07:32:21,794 [myid:] - info [main:environment@100] - client environment:os.arch=amd64 2014-02-12 07:32:21,794 [myid:] - info [main:environment@100] - client environment:os.version=2.6.32-431.el6.x86_64 2014-02-12 07:32:21,795 [myid:] - info [main:environment@100] - client environment:user.name=root 2014-02-12 07:32:21,796 [myid:] - info [main:environment@100] - client environment:user.home=/root 2014-02-12 07:32:21,796 [myid:] - info [main:environment@100] - client environment:user.dir=/usr/local/hadoop 2014-02-12 07:32:21,801 [myid:] - info [main:zookeeper@438] - initiating client connection, connectstring=localhost:2181 sessiontimeout=30000 watcher=org.apache.zookeeper.zookeepermain$mywatcher@10636a7e welcome to zookeeper! 2014-02-12 07:32:21,850 [myid:] - info [main-sendthread(127.0.0.1:2181):clientcnxn$sendthread@966] - opening socket connection to server 127.0.0.1/127.0.0.1:2181. will not attempt to authenticate using sasl (unknown error) jline support is enabled 2014-02-12 07:32:21,868 [myid:] - info [main-sendthread(127.0.0.1:2181):clientcnxn$sendthread@849] - socket connection established to 127.0.0.1/127.0.0.1:2181, initiating session 2014-02-12 07:32:21,906 [myid:] - info [main-sendthread(127.0.0.1:2181):clientcnxn$sendthread@1207] - session establishment complete on server 127.0.0.1/127.0.0.1:2181, sessionid = 0x6744234039810002, negotiated timeout = 30000watcher::watchedevent state:syncconnected type:none path:null [zk: localhost:2181(connected) 0] ls / [hadoop-ha, zookeeper] [zk: localhost:2181(connected) 1] ls /hadoop-ha [cluster2, cluster1] [zk: localhost:2181(connected) 2]
注：集群c2也格式化，产生一个新的zk节点cluster2。4.启动journalnode集群在hadoop101、hadoop102、hadoop103上分别执行命令：/usr/local/hadoop/sbin/hadoop-daemon.sh start journalnode
命令输出(以hadoop101为例)：
[root@hadoop101 hadoop]# /usr/local/hadoop/sbin/hadoop-daemon.sh start journalnode starting journalnode, logging to /usr/local/hadoop/logs/hadoop-root-journalnode-hadoop101.out [root@hadoop101 hadoop]#
在每个节点执行完启动命令后，每个节点都执行以下验证。验证(以hadoop101为例)：
[root@hadoop101 hadoop]# jps 23396 journalnode 23598 jps 22491 quorumpeermain [root@hadoop101 hadoop]#
注：产生一个java进程journalnode。查看一下目录结构：
[root@hadoop101 hadoop]# jps 23396 journalnode 22491 quorumpeermain 23445 jps [root@hadoop101 hadoop]# pwd /usr/local/hadoop [root@hadoop101 hadoop]# ls tmp/ journal [root@hadoop101 hadoop]#
注：启动journalnode后，会在本地磁盘产生一个目录，用户保存namenode的edits文件的数据。
5.格式化集群c1的一个namenode从hadoop101和hadoop102中任选一个即可，这里选择的是hadoop101.
在hadoop101执行命令：/usr/local/hadoop/bin/hdfs namenode -format -clusterid c1
命令输出：
[root@hadoop101 hadoop]# /usr/local/hadoop/bin/hdfs namenode -format -clusterid c1 14/02/12 08:07:59 info namenode.namenode: startup_msg: /************************************************************ startup_msg: starting namenode startup_msg: host = hadoop101/192.168.80.101 startup_msg: args = [-format, -clusterid, c1] startup_msg: version = 2.2.0 startup_msg: classpath = /usr/local/hadoop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-el-1.0.jar:/usr/local/hadoop/share/hadoop/common/lib/jets3t-0.6.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/usr/local/hadoop/share/hadoop/common/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-lang-2.5.jar:/usr/local/hadoop/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-annotations-2.2.0.jar:/usr/local/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/usr/local/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop/share/hadoop/common/lib/zookeeper-3.4.5.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-auth-2.2.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/common/lib/stax-api-1.0.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/common/lib/junit-4.8.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/jsr305-1.3.9.jar:/usr/local/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-logging-1.1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-math-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/usr/local/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/usr/local/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/usr/local/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/usr/local/hadoop/share/hadoop/common/hadoop-common-2.2.0-tests.jar:/usr/local/hadoop/share/hadoop/common/hadoop-common-2.2.0.jar:/usr/local/hadoop/share/hadoop/common/hadoop-nfs-2.2.0.jar:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-el-1.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.2.0.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.2.0-tests.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/hamcrest-core-1.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/junit-4.10.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.final.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/junit-4.10.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/contrib/capacity-scheduler/*.jar startup_msg: build = unknown -r unknown; compiled by 'root' on 2013-12-26t08:50z startup_msg: java = 1.7.0_45 ************************************************************/ 14/02/12 08:07:59 info namenode.namenode: registered unix signal handlers for [term, hup, int] formatting using clusterid: c1 14/02/12 08:08:01 info namenode.hostfilemanager: read includes: hostset( ) 14/02/12 08:08:01 info namenode.hostfilemanager: re