Hadoop 05：HDP Sandbox

hadoop
hadoop

初步介绍HDP的使用。

  1. 环境：VMware + HDP Sandbox for VMware

  2. SSH登录

    1
    2
    3
    ssh root@172.16.147.128 -p 2222
    // 由于HDP使用Docker，必须要加上2222端口号
    // 登录时需要修改root密码

  3. 运行WordCount

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    21
    # cd /usr/hdp/2.5.0.0-1245/hadoop-mapreduce/
    # cp hadoop-mapreduce-examples-2.7.3.2.5.0.0-1245.jar ~
    # cd ~
    # vi word.txt
    i like hadoop
    hadoop is best
    lucky hadoop

    # hdfs dfs -mkdir /user/tyrival
    # hdfs dfs -put word.txt /user/tyrival
    # yarn jar hadoop-mapreduce-examples-2.7.3.2.5.0.0-1245.jar wordcount /user/tyrival/word.txt /user/tyrival/word.txt.out

    # hdfs dfs -text /user/tyrival/word.txt.out/*|cat
    17/04/08 03:08:12 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
    17/04/08 03:08:12 INFO lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev 7a4b57bedce694048432dd5bf5b90a6c8ccdba80]
    best	1
    hadoop	3
    i	1
    is	1
    like	1
    lucky	1

  4. 登录管理界面
    http://sandbox.hortonworks.com:8080/
    sandbox.hortonworks.com通过配置host指向VMware虚拟机的IP
    账号密码：raj_ops / raj_ops

分享到