欢迎投稿

今日深度:

Hive搭建,

Hive搭建,


单用户模式

1.下载mysql

yum install mysql-server -y

2.修改mysql权限:

service mysqld start
GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY '123' WITH GRANT OPTION;

3.删除多余会对权限造成影响的数据

delete from user where host !='%';

4.刷新权限

flush privileges;

5.安装部署包

tar xf apache-hive-1.2.1-bin.tar.gz -C /opt/sxt/

6.修改配置文件
hive/conf/下

 cp hive-default.xml.template hive-site.xml 

hive-site.xml

<?xml version="1.0"?>  
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>  
  
<configuration>
<!--元数据仓库的位置,hdfs上的目录-->  
<property>  
  <name>hive.metastore.warehouse.dir</name>  
  <value>/user/hive_remote/warehouse</value>  
</property> 
<!--本地库还是远程登录,自动识别,可以删掉--> 
<property>  
  <name>hive.metastore.local</name>  
  <value>true</value>  
</property>  
<!--配置连接-->
<property>  
  <name>javax.jdo.option.ConnectionURL</name>  
  <value>jdbc:mysql://node1/hive_remote?createDatabaseIfNotExist=true</value>  
</property>  
   <!-- jdbc驱动包-->
<property>  
  <name>javax.jdo.option.ConnectionDriverName</name>  
  <value>com.mysql.jdbc.Driver</value>  
</property>  
   <!--用户名-->
<property>  
  <name>javax.jdo.option.ConnectionUserName</name>  
  <value>root</value>  
</property>  
   <!--密码-->
<property>  
  <name>javax.jdo.option.ConnectionPassword</name>  
  <value>123</value>  
</property>  
</configuration>  

7.配置环境变量

unset -f pathmunge
export JAVA_HOME=/usr/java/jdk1.7.0_67
export HADOOP_PREFIX=/opt/hadoop-2.6.5
export ZOOKEEPER_PREFIX=/opt/zookeeper-3.4.9
export HIVE_HOME=/opt/hive
export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_PREFIX/bin:$HADOOP_PREFIX/sbin:$ZOOKEEPER_PREFIX/bin:$HIVE_HOME/bin

8.引用新的环境变量

. /etc/profile

9.在hive中添加驱动包

cd   opt/hive/lib/

将驱动包复制到该目录下
10.更新hadoop中的 jline jar包

cd /opt/hadoop-2.6.5/share/hadoop/yarn/lib/
rm -rf  jline-0.9.94.jar
cp /opt/hive/lib/jline-2.12.jar  ./

远程服务器模式

11.共享公共密钥

ssh-copy-id -i id_rsa.pub node3
ssh-copy-id -i id_rsa.pub node4

12.分发hive目录

scp -r hive/ node3:`pwd`
scp -r hive/ node4`pwd`

13.分发profile

scp /etc/profile  node3:/etc/
scp /etc/profile  node4:/etc/

14.node3 hive-site.xml 修改

<?xml version="1.0"?>  
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>  
  
<configuration>
<!--元数据仓库的位置,hdfs上的目录-->  
<property>  
  <name>hive.metastore.warehouse.dir</name>  
  <value>/user/hive/warehouse</value>  
</property> 
<!--本地库还是远程登录,自动识别,可以删掉--> 
<property>  
  <name>hive.metastore.local</name>  
  <value>true</value>  
</property>  
<!--配置连接-->
<property>  
  <name>javax.jdo.option.ConnectionURL</name>  
  <value>jdbc:mysql://node1/hive?createDatabaseIfNotExist=true</value>  
</property>  
   <!-- jdbc驱动包-->
<property>  
  <name>javax.jdo.option.ConnectionDriverName</name>  
  <value>com.mysql.jdbc.Driver</value>  
</property>  
   <!--用户名-->
<property>  
  <name>javax.jdo.option.ConnectionUserName</name>  
  <value>root</value>  
</property>  
   <!--密码-->
<property>  
  <name>javax.jdo.option.ConnectionPassword</name>  
  <value>123</value>  
</property>  
</configuration>  

15.更新node3,node4,hadoop中的 jline jar包

cd /opt/hadoop-2.6.5/share/hadoop/yarn/lib/
rm -rf  jline-0.9.94.jar
cp /opt/hive/lib/jline-2.12.jar  ./

16…node4 hive-site.xml 修改

<?xml version="1.0"?>  
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>  
  
<configuration>
<!--元数据仓库的位置,hdfs上的目录-->  
<property>  
  <name>hive.metastore.warehouse.dir</name>  
  <value>/user/hive/warehouse</value>  
</property> 
<property>  
  <name>hive.metastore.uris</name>  
  <value>thrift://node3:9083</value>  
</property>  
</configuration>

17.启动node3的元数据服务器

hive --service metastore

18.启动客户端 node4

hive

www.htsjk.Com true http://www.htsjk.com/hive/40997.html NewsArticle Hive搭建, 单用户模式 1.下载mysql yum install mysql-server -y 2.修改mysql权限: service mysqld startGRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY '123' WITH GRANT OPTION; 3.删除多余会对权限造成影响的数据...
相关文章
    暂无相关文章
评论暂时关闭