hive metastore 를 mysql 로 설정하기

내 환경은

CentOS 6.6

Oracle Java 1.7.0_79

Apache Hadoop 2.6.0

Apache Hive 1.2.1

Mysql 5.1.73

일단 hive binary 파일을 다운받고 압축풀고 HIVE_HOME, PATH 설정을 해준다

그리고 mysql jdbc driver 를 받아서 압축풀고 jar 파일을 hive/lib 아래로 옮긴다

wget http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.36.tar.gz tar zxvf mysql-connector-java-5.1.36.tar.gz cd mysql-connector-java-5.1.36 cp mysql-connector-java-5.1.36-bin.jar $HIVE_HOME/lib

그리고 $HIVE_HOME/conf 에 가보면

hive-default.xml.template 파일이 있다

복사하면서 파일명을 hive-site.xml 로 바꾼다

아니면 hivemetastore-site.xml 과 hiveserver2-site.xml 로 나눠도 된다

알맞게 설정 후 hive 명령어로 cli 를 실행하든 뭘 하든 하면 된다

hive-site.xml 이어야 반영된다는걸 몰라서 좀 헤맸다

참고 https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin

-------------------------------------------------------------------------------

hivemetastore-site.xml

<?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> </property> <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://localhost/hive?createDatabaseIfNotExist=true</value> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>hive</value> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>hive</value> </property> </configuration>

-------------------------------------------------------------------------------

hiveserver2-site.xml

<?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration> <property> <name>datanucleus.autoStartMechanism</name> <value>SchemaTable</value> </property> <property> <name>hive.metastore.uris</name> <value>thrift://metastore_host:9083</value> </property> <property> <name>hive.metastore.warehouse.dir</name> <value>/user/hive/warehouse</value> </property> <property> <name>datanucleus.autoCreateSchema</name> <value>false</value> </property> <property> <name>datanucleus.fixedDatastore</name> <value>true</value> </property> <property> <name>hive.aux.jars.path</name> <value>/usr/local/hive/jars</value> </property> <property> <name>hive.reloadable.aux.jars.path</name> <value>/usr/local/hive/jars_r</value> </property> <property> <name>hive.autogen.columnalias.prefix.label</name> <value>_c</value> </property> <!--<property> <name>hive.cli.print.header</name> <value>true</value> </property>--> </configuration>

-------------------------------------------------------------------------------

hive-site.xml

<?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration> <property>     <name>datanucleus.autoStartMechanism</name>     <value>SchemaTable</value>  </property> <property> <name>hive.metastore.uris</name> <value>thrift://metastore_host:9083</value> </property> <property> <name>hive.metastore.warehouse.dir</name> <value>/user/hive/warehouse</value> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>hive</value> </property> <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://localhost/hive?createDatabaseIfNotExist=true</value> </property> <property> <name>datanucleus.autoCreateSchema</name> <value>false</value> </property> <property> <name>datanucleus.fixedDatastore</name> <value>true</value> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>hive</value> </property> <property> <name>hive.aux.jars.path</name> <value>/usr/local/hive/jars</value> </property> <property> <name>hive.reloadable.aux.jars.path</name> <value>/usr/local/hive/jars_r</value> </property> <property> <name>hive.autogen.columnalias.prefix.label</name> <value>_c</value> </property> <property> <name>hive.cli.print.header</name> <value>true</value> </property> </configuration>