#12570: Enhance Cloudera Hive to use Simba JDBC drivers or Apache JDBC drivers

tomconrad reported 2014-10-15T20:57:37Z · last modified 2014-10-31T22:24:52Z

Enhance Cloudera Hive to use Simba JDBC drivers or Apache JDBC drivers

Dev	tomconrad
QA	anilkalshetti

Priority	Minor
Complexity	Moderate

Component	Hive
Version	16.0

Here are the steps to use Simba drivers:

Impala -

1) Remove our packaged hive drivers

2) Copy the following jar files:

hive_metastore

hive_service

ImpalaJDBC4

TCLIServiceClient

3) Change CoreHiveDriver to point at the new driver path

return new com.aquafold.aquacore.open.rdbms.drivers.hive.AQHiveDriver2((Driver) Class.forName("com.cloudera.impala.jdbc4.Driver")

.newInstance(), connSettings);

4) Optionally change url to use ;AuthMech=0 instead of ;auth=noSasl. Although both work, It looks like Cloudera added AuthMech to handle which authentication to use.. For example: AuthMech=1 is for Kerberos. Will need to wire this into our Auth panel to url conversion.

Hive2 -

1) Remove our packaged hive drivers

2) Copy the following jar files:

hive_metastore

hive_service

HiveJDBC4

TCLIServiceClient

3) Change CoreHiveDriver to point at the new driver path

return new com.aquafold.aquacore.open.rdbms.drivers.hive.AQHiveDriver2((Driver) Class.forName("com.cloudera.hive.jdbc4.HS2Driver")

.newInstance(), connSettings);

4) Might have to change url for AutoMech???

Also need to change the url from hive2 to impala with the Simba drivers...

jdbc:impala://10.168.2.115:21050/default;AuthMech=0

Should we also wire in Hiverserver1???

All Comments (5) Change History

tomconrad 2014-10-15T21:17:53Z

Will also have to look at versioning relative to hive datatypes since Simba drivers are not following the Apache driver version pattern.. .10, .11, .12, .13.. etc. This will require a bunch of changes.

tomconrad 2014-10-20T15:45:22Z

To test simba drivers, copy the following files from

\\General\Tom\Cloudera Simba Drivers\Cloudera_HiveJDBC4_2.5.4.1006.zip for Hiveserver1 and 2

and/or

\\General\Tom\Cloudera Simba Drivers\Cloudera_ImpalaJDBC4_2.5.5.1007.zip for Impala.

These three files can come from either..

hive_metastore.jar

hive_service.jar

TCLIServiceClient.jar

Both of these files can be loaded..

HiveJDBC4.jar

ImpalaJDBC4.jar

Stop and start ADS.

This works with 5.0 Cloudera server 10.168.2.115, port 10000 for hiveserver2 and port 21050 for impala.

I also added the Cloudera Apache drivers from this server so those can be tested also. They are in

\\General\Tom\Cloudera Apache Drivers\

tomconrad 2014-10-28T20:38:27Z

Here is a link to the Cloudera Simba drivers for Hiveserver1, Hiveserver2 and Impala...

https://drive.google.com/a/aquafold.com/?tab=wo&pli=1#folders/0ByHak_0mBLgzbVUxeEJnUGdLYVk

Hi Anil,

I have not tested Hiveserver1 Are able to do that? Also, do you have Kerberos working? Is it possibile to test?

Thanks in advance, Tom

anilkalshetti 2014-10-30T09:16:22Z

Verified in ADS 16.0.0-dev-16

tariqrahiman 2014-10-31T22:24:52Z

Verified in ADS v16.0.0-dev-19

Search Tips

Aqua Data Studio / nhilam

Enhance Cloudera Hive to use Simba JDBC drivers or Apache JDBC drivers

Issue #12570

Completion

Search Tips

Aqua Data Studio / nhilam

Title

Enhance Cloudera Hive to use Simba JDBC drivers or Apache JDBC drivers

Issue #12570

Completion