sqoop2和sqoop1有較大的區(qū)別。將整體的ETL過(guò)程分割成server和client兩部分執(zhí)行,sqoop2是交互式的操作。
創(chuàng)新互聯(lián)建站主營(yíng)北林網(wǎng)站建設(shè)的網(wǎng)絡(luò)公司,主營(yíng)網(wǎng)站建設(shè)方案,重慶APP開(kāi)發(fā),北林h5微信平臺(tái)小程序開(kāi)發(fā)搭建,北林網(wǎng)站營(yíng)銷(xiāo)推廣歡迎北林等地區(qū)企業(yè)咨詢(xún)解壓安裝
[hadoop@fa01 ~]$ tar -zxvf sqoop-1.99.7-bin-hadoop200.tar.gz -C ./
重命名
[hadoop@fa01 ~]$ mv sqoop-1.99.7-bin-hadoop200 sqoop-1.99.7
同時(shí)新建一個(gè)extra文件,放置mysql的驅(qū)動(dòng)文件(文件名隨意,配置文件相對(duì)應(yīng)上就可以)
[hadoop@fa01 sqoop-1.99.7]$ mkdir extra
[hadoop@fa01 ~]$ mv mysql-connector-java-5.1.5-bin.jar /home/hadoop/sqoop-1.99.7/extra/
配置環(huán)境變量。配置sqoop第三方j(luò)ar包引用變量
[hadoop@fa01 ~]$ vim .bash_profile
export SQOOP_HOME=/home/hadoop/sqoopsqoop-1.99.7
export SQOOP_SERVER_EXTRA_LIB=/home/hadoop/sqoop-1.99.7/extra
修改hadoop的core-site.xml文件,這里的hadoop為用戶(hù)名
[hadoop@fa01 ~]$ cd hadoop-2.6.0-cdh6.5.2/etc/hadoop
[hadoop@fa01 hadoop]$ vim core-site.xml
配置sqoop里的conf文件里面的# Hadoop configuration directory
[hadoop@fa01 ~]$ cd sqoop-1.99.7/conf/
[hadoop@fa01 conf]$ vim sqoop.properties
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/home/hadoop/hadoop-2.6.0-cdh6.5.2/etc/hadoop
檢查sqoop是否配置成功
[hadoop@fa01 bin]$ ./sqoop2-tool verify
Setting conf dir: /home/hadoop/sqoop-1.99.7/bin/../conf
Sqoop home directory: /home/hadoop/sqoop-1.99.7
Sqoop tool executor:
Version: 1.99.7
Revision:435d5e61b922a32d7bce567fe5fb1a9c0d9b1bbb
Compiled on Tue Jul 19 16:08:27 PDT 2016 by abefine
Running tool: class org.apache.sqoop.tools.tool.VerifyTool
2017-06-21 01:31:48,489 INFO [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server.
2017-06-21 01:31:48,539 INFO [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread
Verification was successful.
Tool class org.apache.sqoop.tools.tool.VerifyTool has finished correctly.
啟動(dòng)sqoop
[hadoop@fa01 bin]$ ./sqoop2-server start
Setting conf dir: /home/hadoop/sqoop-1.99.7/bin/../conf
Sqoop home directory: /home/hadoop/sqoop-1.99.7
Starting the Sqoop2 server...
2017-06-21 01:32:31,088 INFO [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server.
2017-06-21 01:32:31,100 INFO [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread
Sqoop2 server started.
另外有需要云服務(wù)器可以了解下創(chuàng)新互聯(lián)scvps.cn,海內(nèi)外云服務(wù)器15元起步,三天無(wú)理由+7*72小時(shí)售后在線(xiàn),公司持有idc許可證,提供“云服務(wù)器、裸金屬服務(wù)器、高防服務(wù)器、香港服務(wù)器、美國(guó)服務(wù)器、虛擬主機(jī)、免備案服務(wù)器”等云主機(jī)租用服務(wù)以及企業(yè)上云的綜合解決方案,具有“安全穩(wěn)定、簡(jiǎn)單易用、服務(wù)可用性高、性?xún)r(jià)比高”等特點(diǎn)與優(yōu)勢(shì),專(zhuān)為企業(yè)上云打造定制,能夠滿(mǎn)足用戶(hù)豐富、多元化的應(yīng)用場(chǎng)景需求。