版本

hive-0.13.1-bin

修改日志hive-log4j.properties

hive.root.logger=INFO,DRFA
hive.log.dir=/opt/modules/hive-0.13.1-bin/logs
 
[kfk@bigdata-pro03 hive-0.13.1-bin]$ mkdir logs

修改环境变量 hive-env.sh

 HADOOP_HOME=/opt/modules/hadoop-2.5.0
 export HIVE_CONF_DIR=/opt/modules/hive-0.13.1-bin/conf

配置元数据库

<property>
  <name>javax.jdo.option.ConnectionURL</name>
  <value>jdbc:mysql://bigdata-pro01.kfk.com/metastore?createDatabaseIfNotExist=true</value>
</property>
 
<property>
  <name>javax.jdo.option.ConnectionDriverName</name>
  <value>com.mysql.jdbc.Driver</value>
</property>
 
<property>
  <name>javax.jdo.option.ConnectionUserName</name>
  <value>root</value>
</property>
 
<property>
  <name>javax.jdo.option.ConnectionPassword</name>
  <value>123456</value>
</property>

其他-可选

<property>
	<name>hive.cli.print.header</name>
	<value>true</value>
</property>
<property>
	<name>hive.cli.print.current.db</name>
	<value>true</value>
</property>
<property>
  	<name>hbase.zookeeper.quorum</name>
  	<value>bigdata-pro01.kfk.com,bigdata-pro02.kfk.com,bigdata-pro03.kfk.com</value>
</property>

hadoop设置

[kfk@bigdata-pro03 modules]$ hadoop-2.5.0/bin/hadoop fs -mkdir /tmp
[kfk@bigdata-pro03 modules]$ hadoop-2.5.0/bin/hdfsd fs -mkdir -p /user/hive/warehouse
 
[kfk@bigdata-pro03 modules]$ hadoop-2.5.0/bin/hadoop fs -chmod g+w /user/hive/warehouse
[kfk@bigdata-pro03 modules]$ hadoop-2.5.0/bin/hadoop fs -chmod g+w /tmp

Hive与Mysql集成

查询用户信息
mysql> select host,user,password from user;

+-----------------------+------+-------------------------------------------+
| host                  | user | password                                  |
+-----------------------+------+-------------------------------------------+
| localhost             | root | *6BB4837EB74329105EE4568DDA7DC67ED2CA2AD9 |
| bigdata-pro01.kfk.com | root |                                           |
| 127.0.0.1             | root |                                           |
| localhost             |      |                                           |
| bigdata-pro01.kfk.com |      |                                           |
+-----------------------+------+-------------------------------------------+
 

更新并删除用户信息

update user set host='%' where User='root' and host='localhost'
delete from user where host ='bigdata-pro01.kfk.com';                
delete from user where host ='127.0.0.1' and user='root'; 
delete from user where host ='localhost';  

mysql> select host,user,password from user;

+------+------+-------------------------------------------+
| host | user | password                                  |
+------+------+-------------------------------------------+
| %    | root | *6BB4837EB74329105EE4568DDA7DC67ED2CA2AD9 |
+------+------+-------------------------------------------+
1 row in set (0.00 sec)

刷新信息
mysql> flush privileges;

启动

[kfk@bigdata-pro03 hive-0.13.1-bin]$ bin/hive

验证

hive (default)> show databases;
OK
database_name
default
hive (default)> use default;
OK
Time taken: 0.015 seconds
hive (default)> show tables;
OK
tab_name
Time taken: 0.021 seconds
hive (default)> 

查看mysql元数据库变化

mysql> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| metastore          |
| mysql              |
| test               |
+--------------------+
4 rows in set (0.00 sec)
mysql> select * from TBLS;
Empty set (0.00 sec)

建表

create table test(id int,name string) ROW FORMAT DELIMITED FIELDS  TERMINATED BY '\t';  
 
show tables;                               
OK
tab_name
test
Time taken: 0.018 seconds, Fetched: 1 row(s)

Mysql 元数据库变化

mysql> select TBL_NAME,OWNER,CREATE_TIME from TBLS; 
+----------+-------+-------------+
| TBL_NAME | OWNER | CREATE_TIME |
+----------+-------+-------------+
| test     | kfk   |  1592845787 |
+----------+-------+-------------+
1 row in set (0.00 sec)
 

加载数据

hive (default)> load data local inpath '/opt/datas/test.txt' into table test;
Copying data from file:/opt/datas/test.txt
Copying file: file:/opt/datas/test.txt
Loading data to table default.test
Table default.test stats: [numFiles=1, numRows=0, totalSize=18, rawDataSize=0]
OK