hive环境搭建，

hive环境搭建，

hive环境搭建相比较其他组件而言，很简单

 

1安装mysql

(如果机器自带可以省略该步骤)

[root@localhost hive-x.x.x]# yum install mysql  mysql-server mysql-devel

设置mysql配置文件/etc/my.cnf中加入default-character-set=latin1

启动mysql

[root@localhost hive-x.x.x]# /etc/init.d/mysqld start

开机启动

[root@localhost hive-x.x.x]# chkconfig --add mysqld

[root@localhost hive-x.x.x]# chkconfig --level 2345 mysqld on

设置mysql root密码

[root@localhost hive-x.x.x]# mysqladmin -uroot password 111111

创建hive数据库

mysql> create database hive;

2 hive数据库mysql相关设置

设置hive-site.xml

[root@localhost hive-x.x.x]# vim conf/hive-site.xml

<configuration>

<property>

<name>javax.jdo.option.ConnectionURL</name> 

<value>jdbc:mysql://localhost:3306/hive</value>

</property>

<property>

<name>javax.jdo.option.ConnectionDriverName</name>

<value>com.mysql.jdbc.Driver</value>

</property>

<property>

<name>javax.jdo.option.ConnectionUserName</name>

<value>root</value>

</property>

<property>

<name>javax.jdo.option.ConnectionPassword</name>

<value>111111</value>

</property>

<property>

<name>datanucleus.schema.autoCreateAll</name>

<value>true</value>

</property>

<property>

<name>hive.metastore.warehouse.dir</name>

<value>/user/hive/warehouse</value>

</property>

<property>

<name>hive.exec.scratchdir</name>

<value>/tmp/hive</value>

</property>

<property>

<name>hive.scratch.dir.permission</name>

<value>700</value>

</property>

</configuration>

相关共享文件夹创建

[hdfs@localhost hadoop-2.6.0]$ ./bin/hadoop fs -mkdir /tmp

[hdfs@localhost hadoop-2.6.0]$ ./bin/hadoop fs -chmod a+w /tmp

[hdfs@localhost hadoop-2.6.0]$ ./bin/hadoop fs -mkdir -p /user/hive/warehouse

[hdfs@localhost hadoop-2.6.0]$ ./bin/hadoop fs -chmod a+w /user/hive/warehouse

[hdfs@localhost hadoop-2.6.0]$ ./bin/hadoop fs -chown hive: /user/hive

拷贝数据库驱动mysql-connector-java-xxx-bin.jar到hive的lib下面

[root@localhost hive-x.x.x]# mv mysql-connector-java.jar lib/

设置hive日志

[root@localhost hive-x.x.x]# cp conf/hive-log4j2.properties.template conf/hive-log4j2.properties

初始化好数据

执行初始化命令：schematool -dbType mysql -initSchema

查看初始化后的信息： schematool -dbType mysql -info

详见：https://cwiki.apache.org/confluence/display/Hive/Hive+Schema+Tool

3启动hive

[hive@localhost hive-x.x.x]$ ./bin/hive

hive> show tables;

OK

Time taken: 0.766 seconds

hive> create table dummy (value string);

OK

Time taken: 0.091 seconds

hive> show tables;

OK

dummy

Time taken: 0.751 seconds, Fetched: 1 row(s)

ps：创建数据文件dummy.txt,echo "aaa" > /tmp/dummy.txt

hive> load data local inpath '/tmp/dummy.txt' overwrite into table dummy;

Loading data to table default.dummy

OK

Time taken: 0.993 seconds

hive> select * from dummy;

OK

aaa

Time taken: 0.732 seconds, Fetched: 1 row(s)

 

 

---

 [徐银浩PC1]mysql版本要求？