真实的国产乱ⅩXXX66竹夫人,五月香六月婷婷激情综合,亚洲日本VA一区二区三区,亚洲精品一区二区三区麻豆

成都創(chuàng)新互聯(lián)網(wǎng)站制作重慶分公司

Hadoop單機(jī)版安裝

實(shí)驗(yàn)環(huán)境:

成都創(chuàng)新互聯(lián)公司2013年開創(chuàng)至今,是專業(yè)互聯(lián)網(wǎng)技術(shù)服務(wù)公司,擁有項(xiàng)目網(wǎng)站制作、網(wǎng)站建設(shè)網(wǎng)站策劃,項(xiàng)目實(shí)施與項(xiàng)目整合能力。我們以讓每一個(gè)夢(mèng)想脫穎而出為使命,1280元鑲黃做網(wǎng)站,已為上家服務(wù),為鑲黃各地企業(yè)和個(gè)人服務(wù),聯(lián)系電話:18982081108

操作系統(tǒng):Ubuntu 16.04 LTS

Hadoop版本:Hadoop 2.7.1

一、安裝JAVA環(huán)境

dblab@dblab-VirtualBox:/$ sudo apt-get install default-jre default-jdk

dblab@dblab-VirtualBox:/$ vim ~/.bashrc

export JAVA_HOME=/usr/lib/jvm/default-java

dblab@dblab-VirtualBox:/$ source ~/.bashrc?#使變量設(shè)置生效

dblab@dblab-VirtualBox:/$ echo $JAVA_HOME

/usr/lib/jvm/default-java

dblab@dblab-VirtualBox:/$ java -version

openjdk version "1.8.0_131"

OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)

OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)

二、安裝Hadoop

dblab@dblab-VirtualBox:/$ cd ?~/下載

dblab@dblab-VirtualBox:~/下載$ ?wget http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-2.6.5/hadoop-2.6.5.tar.gz?

dblab@dblab-VirtualBox:~/下載$ sudo tar -zxvf hadoop-2.6.5.tar.gz -C /usr/local

dblab@dblab-VirtualBox:/usr/local$ sudo mv ./hadoop-2.6.5/ ./hadoop??#更改文件夾名稱

dblab@dblab-VirtualBox:/usr/local$ sudo chown -R hadoop ./hadoop/??#修改文件夾權(quán)限

dblab@dblab-VirtualBox:/usr/local/hadoop$ ./bin/hadoop version??? ?#顯示版本信息

Hadoop 2.7.1

Subversion https://git-wip-us.apache.org/repos/asf/hadoop.git -r 15ecc87ccf4a0228f35af08fc56de536e6ce657a

Compiled by jenkins on 2015-06-29T06:04Z

Compiled with protoc 2.5.0

From source with checksum fc0a1a23fc1868e4d5ee7fa2b28a58a

This command was run using /usr/local/hadoop/share/hadoop/common/hadoop-common-2.7.1.jar

三、Hadoop單機(jī)配置

Hadoop 默認(rèn)模式為非分布式模式(本地模式),無(wú)需進(jìn)行其他配置即可運(yùn)行。

可以執(zhí)行例子來(lái)感受下 Hadoop 的運(yùn)行。Hadoop 附帶了豐富的例子

dblab@dblab-VirtualBox:/usr/local/hadoop$ ./bin/hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar????

An example program must be given as the first argument.

Valid program names are:

? aggregatewordcount: An Aggregate based map/reduce program that counts the words in the input files.

? aggregatewordhist: An Aggregate based map/reduce program that computes the histogram of the words in the input files.

? bbp: A map/reduce program that uses Bailey-Borwein-Plouffe to compute exact digits of Pi.

? dbcount: An example job that count the pageview counts from a database.

? distbbp: A map/reduce program that uses a BBP-type formula to compute exact bits of Pi.

? grep: A map/reduce program that counts the matches of a regex in the input.

? join: A job that effects a join over sorted, equally partitioned datasets

? multifilewc: A job that counts words from several files.

? pentomino: A map/reduce tile laying program to find solutions to pentomino problems.

? pi: A map/reduce program that estimates Pi using a quasi-Monte Carlo method.

? randomtextwriter: A map/reduce program that writes 10GB of random textual data per node.

? randomwriter: A map/reduce program that writes 10GB of random data per node.

? secondarysort: An example defining a secondary sort to the reduce.

? sort: A map/reduce program that sorts the data written by the random writer.

? sudoku: A sudoku solver.

? teragen: Generate data for the terasort

? terasort: Run the terasort

? teravalidate: Checking results of terasort

? wordcount: A map/reduce program that counts the words in the input files.

? wordmean: A map/reduce program that counts the average length of the words in the input files.

? wordmedian: A map/reduce program that counts the median length of the words in the input files.

? wordstandarddeviation: A map/reduce program that counts the standard deviation of the length of the words in the input files.

$cd /usr/local/hadoop

$sudo mkdir ./input

$sudo cp ./etc/hadoop/*.xml ./input??#將配置文件作為輸入文件

$./bin/hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar grep ./input ./output 'dfs[a-z.]+'

$cat ./output/*?????????# 查看運(yùn)行結(jié)果

dblab@dblab-VirtualBox:/usr/local/hadoop$ cat ./output/*

1?????? dfsadmin

?

?

??????????????????????

?


分享文章:Hadoop單機(jī)版安裝
分享網(wǎng)址:http://weahome.cn/article/pdgpii.html

其他資訊

在線咨詢

微信咨詢

電話咨詢

028-86922220(工作日)

18980820575(7×24)

提交需求

返回頂部