刚刚在虚拟机上安装并配置了hadoop伪分布式集群,根据《hadoop实战》上的提示,启动Hadoop前需要格式化Hadoop的文件系统HDFS。命令如下:
[root@localhost hadoop-1.0.4]# bin/hadoop NameNode -format
执行命令后报错:
Exception in thread "main" java.lang.NoClassDefFoundError: NameNode
参考了网上的一些文章:
大部分给出的方案都是修改conf/hadoop-env.sh配置文件,增加
export HADOOP_COMMON_HOME=/root/hadoop-1.0.4 (hadoop的安装目录)
但是重新执行后还是报错
接下来又修改了环境变量,增加了HADOOP_HOME配置:
HADOOP_HOME=/root/hadoop-1.0.4 PATH=$JAVA_HOME/bin:$PATH:$HADOOP_HOME/bin export CATALINA_HOME JAVA_HOME CLASSPATH PATH HADOOP_HOME
执行后还是报错。
之后仔细看了一些解决方案之后发现网上给出的正确命令是:
bin/hadoop namenode -format
其中namenode是小写,我把我的执行命令里NameNode修改为小写后再次执行,发现成功了
[root@localhost hadoop-1.0.4]# bin/hadoop namenode -format 13/03/07 08:28:20 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = localhost/127.0.0.1 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 1.0.4 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r 1393290; compiled by 'hortonfo' on Wed Oct 3 05:13:58 UTC 2012 ************************************************************/ 13/03/07 08:28:20 INFO util.GSet: VM type = 32-bit 13/03/07 08:28:20 INFO util.GSet: 2% max memory = 19.84625 MB 13/03/07 08:28:20 INFO util.GSet: capacity = 2^22 = 4194304 entries 13/03/07 08:28:20 INFO util.GSet: recommended=4194304, actual=4194304 13/03/07 08:28:21 INFO namenode.FSNamesystem: fsOwner=root 13/03/07 08:28:21 INFO namenode.FSNamesystem: supergroup=supergroup 13/03/07 08:28:21 INFO namenode.FSNamesystem: isPermissionEnabled=true 13/03/07 08:28:21 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100 13/03/07 08:28:21 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s) 13/03/07 08:28:21 INFO namenode.NameNode: Caching file names occuring more than 10 times 13/03/07 08:28:21 INFO common.Storage: Image file of size 110 saved in 0 seconds. 13/03/07 08:28:21 INFO common.Storage: Storage directory /tmp/hadoop-root/dfs/name has been successfully formatted. 13/03/07 08:28:21 INFO namenode.NameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down NameNode at localhost/127.0.0.1 ************************************************************/
格式化成功后启动Hadoop所有进程
[root@localhost hadoop-1.0.4]# bin/start-all.sh starting namenode, logging to /root/hadoop-1.0.4/libexec/../logs/hadoop-root-namenode-localhost.out localhost: starting datanode, logging to /root/hadoop-1.0.4/libexec/../logs/hadoop-root-datanode-localhost.out localhost: starting secondarynamenode, logging to /root/hadoop-1.0.4/libexec/../logs/hadoop-root-secondarynamenode-localhost.out starting jobtracker, logging to /root/hadoop-1.0.4/libexec/../logs/hadoop-root-jobtracker-localhost.out localhost: starting tasktracker, logging to /root/hadoop-1.0.4/libexec/../logs/hadoop-root-tasktracker-localhost.out
启动后我们可以验证一下Hadoop是否安装成功,在浏览器中分别访问以下两个地址:
http://localhost:50030/ (MapReduce的web页面)
http://localhost:50070/ (HDFS的web页面)
如果都能访问,说明Hadoop已经安装成功。
附:参考资料
http://blog.csdn.net/zuoanlove/article/details/8255162
http://stackoverflow.com/questions/2004786/error-in-starting-namenode-in-hadoop
相关推荐
主要介绍了Exception in thread main java.lang.NoClassDefFoundError错误解决方法,需要的朋友可以参考下
解决方案:Exceptionin thread "main" java.lang.UnsatisfiedLinkError:org.apache.hadoop.util.NativeCrc32.nativeCo
运行Sqoop报错:Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/avro/LogicalType,下载此资源放到Sqoop的lib目录下即可
Exception in thread “main” java. lang . UnsatisfiedLinkError: org. apache . hadoop. io. nativeio. NativeIOSWindows . access0 (Ijava/ lang/String;I)Z 原因:在调用NativeIO中的...
Exception in thread "main" java.lang.UnsatisfiedLinkError:''boolean org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(java.lang.String, int)' * at org.apache.hadoop.io.nativeio.NativeIO$...
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234) at org.apache.sqoop.Sqoop.runTool...
【kettle集成cdh6.1】外部数据源读写hdfs若干错前言环境报错问题分析解决办法后记 前言 最近试着上手了一下kettle,搭建过程很简单,就是下载个包解压一下,但是在配置数据源的过程中着实踩了不少坑,这里记录一下。...
org.apache.hadoop.mapred.YarnChild: Error running child : java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected at org.apache...
大数据安全-kerberos技术-hadoop安装包,hadoop版本:hadoop-3.3.4.tar.gz
Exception in thread "main" java.lang.NoClassDefFoundError: com/sun/jersey/api/client/config/ClientConfig at org.apache.hadoop.yarn.client.api.TimelineClient.createTimelineClient(TimelineClient.java:...
FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient 解决方法 ...
大数据课程自备资料:Hadoop安装指南 + Linux常用操作命令
java.lang.IllegalArgumentException: System memory 259522560 must be at least 471859200. Please increase heap size using the --driver-memory option or spark.driver.memory in Spark configuration.at.org....
报错:java.lang.Exception: java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z 所需文件
【SpringBoot】Error: java.lang.ClassNotFoundException: org.wltea.analyzer.core.IKSegmenter报错明细问题分析后记 报错明细 IDEA SpringBoot集成hadoop运行环境,本地启动项目,GET请求接口触发远程提交...
at org.apache.hadoop.util.Shell.runCommand(Shell.java:482) 2:window10操作系统下面。hadoop-2.6.4版本,解决上面这个问题的必须两个文件。详细见博客:http://www.cnblogs.com/biehongli/p/7895857.html 3:...
一开始使用的是原生的hadoop2.6.0编译的hadoop.dll,但是一直遇到这个问题Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String...
9001 dfs.namenode.rpc-address,DataNode会连接这个端口 50070 dfs.namenode.http-address 50470 dfs.namenode.https-address 50100 dfs.namenode.backup.address 50105 dfs.namenode.backup.http-address 50090 ...
FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient 通过控制台的...
部分报错如下: Traceback (most recent call last): File /home/cisco/spark-mongo-test.py, line 7, in df = spark.read.format(com.mongodb.spark.sql.DefaultSource).load() File /home/cisco/spark-...