hadoop2.2.0在windows上安装

来源:网络收集 打印文章内容   下载WORD版到本地  

hadoop2.2.0 在 windows 上安装 分类: hapoop2013-12-30 20:28 2480 人阅读 评论(5) 收藏 目录(?)[+] Good news for Hadoop developers who want to use Microsoft Windows OS for their development activities. Finally Apache Hadoop 2.2.0 release officially supports for running Hadoop on Microsoft Windows as well. But the bin distribution of Apache Hadoop 2.2.0 release does not contain some windows native components (likewinutils.exe, hadoop.dll etc). As a result, if we try to run Hadoop in windows, we'll encounter ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary path In this article, I'll describe how to build bin native distribution from source codes, install, configure and run Hadoop in Windows Platform. Tools and Technologies used in this article : 1. 2. 3. 4. 5. 6. 7. Apache Hadoop 2.2.0 Source codes Windows 7 OS Microsoft Windows SDK v7.1 Maven 3.1.1 Protocol Buffers 2.5.0 Cygwin JDK 1.6 Build Hadoop bin distribution for Windows 1. 2. 3. 4. 5. Download and install Microsoft Windows SDK v7.1 . Download and install Unix command-line tool Cygwin . Download and install Maven 3.1.1 . Download Protocol Buffers 2.5.0 and extract to a folder (say c:\protobuf ). Add Environment Variables JAVA_HOME , M2_HOME and Platform if not added already.

Add Environment Variables: Note : Variable name Platform is case sensitive. And value will be either x64 orWin32 for building on a 64-bit or 32-bit system. Edit Path Variable to add bin directory of Cygwin (say C:\cygwin64\bin ), bindirectory of Maven (say C:\maven\bin ) and installation path of Protocol Buffers(say c:\protobuf ). Edit Path Variable:

6. Download hadoop-2.2.0-src.tar.gz and extract to a folder having short path (sayc:\hdfs ) to avoid runtime problem due to maximum path length limitation in Windows. Select Start --> All Programs --> Microsoft Windows SDK v7.1 and open Windows SDK 7.1 Command Prompt . Change directory to Hadoop source code folder (c:\hdfs ). Execute mvn package with options -Pdist,native-win -DskipTests -Dtarto create Windows binary tar distribution. Windows SDK 7.1 Command Prompt Setting SDK environment relative to C:\Program Files\Microso ft SDKs\Windows\v7.1\. Targeting Windows 7 x64 Debug 7.

C:\Program Files\Microsoft SDKs\Windows\v7.1>cd c:\hdfs C:\hdfs>mvn package -Pdist,native-win -DskipTests -Dtar [INFO] Scanning for projects... [INFO] ----------------------------------------------------------------------[INFO] Reactor Build Order: [INFO] [INFO] Apache Hadoop Main [INFO] Apache Hadoop Project POM [INFO] Apache Hadoop Annotations [INFO] Apache Hadoop Assemblies [INFO] Apache Hadoop Project Dist POM [INFO] Apache Hadoop Maven Plugins [INFO] Apache Hadoop Auth [INFO] Apache Hadoop Auth Examples [INFO] Apache Hadoop Common [INFO] Apache Hadoop NFS [INFO] Apache Hadoop Common Project [INFO] Apache Hadoop HDFS [INFO] Apache Hadoop HttpFS

[INFO] Apache Hadoop HDFS BookKeeper Journal [INFO] Apache Hadoop HDFS-NFS [INFO] Apache Hadoop HDFS Project [INFO] hadoop-yarn [INFO] hadoop-yarn-api [INFO] hadoop-yarn-common [INFO] hadoop-yarn-server [INFO] hadoop-yarn-server-common [INFO] hadoop-yarn-server-nodemanager [INFO] hadoop-yarn-server-web-proxy [INFO] hadoop-yarn-server-resourcemanager [INFO] hadoop-yarn-server-tests [INFO] hadoop-yarn-client [INFO] hadoop-yarn-applications [INFO] hadoop-yarn-applications-distributedshell [INFO] hadoop-mapreduce-client [INFO] hadoop-mapreduce-client-core [INFO] hadoop-yarn-applications-unmanaged-am-launcher [INFO] hadoop-yarn-site

[INFO] hadoop-yarn-project [INFO] hadoop-mapreduce-client-common [INFO] hadoop-mapreduce-client-shuffle [INFO] hadoop-mapreduce-client-app [INFO] hadoop-mapreduce-client-hs [INFO] hadoop-mapreduce-client-jobclient [INFO] hadoop-mapreduce-client-hs-plugins [INFO] Apache Hadoop MapReduce Examples [INFO] hadoop-mapreduce [INFO] Apache Hadoop MapReduce Streaming [INFO] Apache Hadoop Distributed Copy [INFO] Apache Hadoop Archives [INFO] Apache Hadoop Rumen [INFO] Apache Hadoop Gridmix [INFO] Apache Hadoop Data Join [INFO] Apache Hadoop Extras [INFO] Apache Hadoop Pipes [INFO] Apache Hadoop Tools Dist [INFO] Apache Hadoop Tools

  • redHat linux下安装hadoop 0.20.2, 并在windows下远程连接此hadoop,开发调试

    redHat linux下安装hadoop 0.20.2, 并在windows下远程连接此hadoop,开发调试

    redHat linux下安装hadoop 0.20.2, 并在windows下远程连接此hadoop,开发调试...

    贡献者:网络收集
    79932
  • Windows平台上安装Hadoop-0.20.203.0版本方法

    Windows平台上安装Hadoop-0.20.203.0版本方法

    Windows平台上安装Hadoop-0.20.203.0版本方法...

    贡献者:网络收集
    908860
  • Windows 7硬盘安装CentOS 7.0_V1.2

    Windows 7硬盘安装CentOS 7.0_V1.2

    Windows 7硬盘安装CentOS 7.0_V1.2...

    贡献者:网络收集
    198464
  • Windows 7从零开始学安装 初级二

    Windows 7从零开始学安装 初级二

    Windows 7从零开始学安装 初级二...

    贡献者:网络收集
    568206
  • Windows 2008 R2上安装Oracle 11g2 For Windows

    Windows 2008 R2上安装Oracle 11g2 For Windows

    Windows 2008 R2上安装Oracle 11g2 For Windows...

    贡献者:网络收集
    933020
  • ImageSAN 2.0 快速安装 (windows 2003)

    ImageSAN 2.0 快速安装 (windows 2003)

    ImageSAN 2.0 快速安装 (windows 2003)...

    贡献者:网络收集
    181519
  • Windows 2008 R2 安装 Enterprise Vault 10.0.2教程(二)

    Windows 2008 R2 安装 Enterprise Vault 10.0.2教程(二)

    Windows 2008 R2 安装 Enterprise Vault 10.0.2教程(二)...

    贡献者:网络收集
    583859
  • RoseMirrorHA 3.2.0 for Windows快速安装手册

    RoseMirrorHA 3.2.0 for Windows快速安装手册

    RoseMirrorHA 3.2.0 for Windows快速安装手册...

    贡献者:网络收集
    628557
  • Windows 7上安装VMWare Server 2.0 + CentOS 5.6 + Oracle11g

    Windows 7上安装VMWare Server 2.0 + CentOS 5.6 + Oracle11g

    Windows 7上安装VMWare Server 2.0 + CentOS 5.6 + Oracle11g...

    贡献者:网络收集
    800678
  • windows8和windows server2012不联网安装.net 3.5(包括2.0和3.0)

    windows8和windows server2012不联网安装.net 3.5(包括2.0和3.0)

    windows8和windows server2012不联网安装.net 3.5(包括2.0和3.0)...

    贡献者:网络收集
    292332
  • 网友在搜
    log4j记录错误日志 hyperdunk17配色 server 2012 r2 ad域 michael buble 微盘 python open ansi gulirana mp3下载 img 居中 缩放 banbendongmei 秋色之空ova百度云 udp 客户端端口限制 fu gem1n b 1h n stak04 磁力 macos自带软件解释 钟馗捉妖记微博 3.5mm 还是莲花头 cloris floral北京 be black in the face green vpn攻略 dell vostro 14拆机 江苏皓腾是正规公司吗 making*lovers CG包 新悲惨世界 马提尼斯 ad修改线宽 动画剪辑加歌曲 fornarina screwmywife 正大集团 通讯录 华为m3和m3青春版 sql 生成唯一编号 国际市场营销方案 aj12羊毛测评 torpedoing 182.247.156.114 s905m b 粤11选5推荐直选3 旗帜更鲜艳首映 升级年费会员 第一次妇科检查脱裤子 山东卫视吧 熊颜文字 赤兔加速器使用方法 snis850图解 present state pokemon go抓神兽技巧 分羊1 22攻略 22nm处理器 single rank dimm 国外润滑油品牌 温州夜场招聘男公关 qt ubuntu编译错误 consortia 翻译 sonicwall tz215 man pantyhose DSD—694 magnet Listen and tick nantongfreeboy g.a.minton jn5169模块

    声明:本站内容源于网络,出于传递更多信息之目的,并不意味着赞同其观点或证实其描述。文章内容仅供参考,请咨询相关专业人士。

    如果无意之中侵犯了您的版权,或有意见、反馈或投诉等情况, 联系我们:shnews500#tom.com

    All Rights Reserved 海日网 手机站 网站地图 网站栏目