#11837: Can't connect with HiveServer2 for Cloudera Distribution

anilkalshetti reported 2014-03-10T09:36:15Z · last modified 2014-03-21T18:19:37Z

Can't connect with HiveServer2 for Cloudera Distribution

Dev	tomconrad
QA	tariqrahiman

Priority	Low
Complexity	Unknown

Component	Hive
Version	14.0

Aqua Data Studio 14.0.9
Build #: 36459
Built on: 2014-Mar-05 01:14:15 PM

Distribution: Cloudera [HiveServer2]
Cloudera Quickstart VM CDH4.4 [Hive 0.10]
CentOS 6.2 and includes CDH4.4, Cloudera Manager 4.7.2
Running HiveServer2

Issue: Can't connect with HiveServer2 for Cloudera Distribution

Steps to reproduce Issue:
1. Copy the cloudera hive drivers from cloudera VM to ADS drivers directory, and start ADS
2. Register Server with below credentials [Please refer screenshot]

Name: HS2_Cloudera_14-09
Connection Type: HiveServer2
Distribution: Cloudera
Host: localhost
Port: 10000

3. Click on Test Connection
[For ADS 14.0.9 and ADS 15.0.0-dev-148, Cloudera Hive drivers are used in ADS drivers directory]
4. a] ADS 14.0.9 -> Doesn't connect
b] ADS 15.0.0-dev-148 -> Doesn't connect
c] ADS 15.0.0-dev-29 -> Connected to HiveServer2

5. All 3 builds mentioned above[step4], successfully connects with Cloudera HiveServer1.

3 attachments

2ClouderaHS2Connection14.png

2014-03-10T09:54:55Z

335 KB
4HS2_cloudera_1409_D-cloudera.png

2014-03-11T14:28:45Z

366 KB
3HS2_cloudera_1409_D-apache.png

2014-03-11T14:28:45Z

456 KB

All Comments (9) Change History

SachinPrakash 2014-03-10T16:39:46Z

@anil: pls attach the datastudio logs so we can examine further. Pls also provide a screenshot showing the error message you're receiving.

tomconrad 2014-03-10T16:48:52Z

Hi Anilkumar,

This seems to work for me.. Can you check in your Driver tab that the connection url contains auth=noSasl?

Like - jdbc:hive2://10.168.2.224:21050/default;auth=noSasl

This should automatically be added when the distribution is Cloudera and type is No Authentication.

Thanks,

Tom

anilkalshetti 2014-03-11T14:44:01Z

@Sachin
@anil: pls attach the datastudio logs so we can examine further. Pls also provide a screenshot showing the error message you're receiving.
>> It doesn't show any error message in View Log or ADS Log file. If Distribution: Cloudera is selected, clicking on Test Connection, It shows progress bar Test Connection dialog box for indefinite time.
Please refer screenshot: 4HS2_cloudera_1409_D-cloudera

@Thomas
Question:Can you check in your Driver tab that the connection url contains auth=noSasl?
>> Yes, connection url contains auth=noSasl
Please refer screenshot: 4HS2_cloudera_1409_D-cloudera

[for Cloudera VM]
In ADS 15.0.0-dev-29, I'm able to connect to Cloudera Hive HS2, and able to create table "test_29".
In ADS 14.0.9, If Distribution: Apache is selected, then HS2 connection successfully happens.
but while creating table it shows error.

Please refer screenshot: 3HS2_cloudera_1409_D-apache.png

tomconrad 2014-03-11T17:01:58Z

Hi Anil,

Try removing the '-' from test_1409-D_apache and see if that creates the table. Hive doesn't like hyphens. Only alphanumeric characters and _

Thanks,

Tom

tomconrad 2014-03-11T17:08:03Z

Hi again,

For the connection problem, try adding ?auth=noSasl to the parameter field under the Driver tab. Let me know if that fixes the problem..

Thanks,

Tom

anilkalshetti 2014-03-18T10:34:31Z · (edited)

Here are detailed steps, followed by me to start HiveServer2 on Cloudera Quickstart VM CDH4.4 [Hive 0.10]

1. Start the VM [Network:NAT], login to Cloudera Manager through browser, stop hive services.

2. From Service hive1-Configuration tab- Disable "HiveServer2 Enable Impersonation" property.

3. Create hive warehouse directory

>>sudo mkdir -p /user/hive/warehouse

>>sudo chmod 777 -R /user/hive/warehouse

4. To add property in hive-site.xml, open it

>>sudo gedit /etc/hive/conf/hive-site.xml

5. Copy the below property in hive-site.xml [Or refer hive-site.xml file attachment]

[ Reference Link: http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/4.2.0/CDH4-Installation-Guide/cdh4ig_topic_18_5.html ]

<property>

<name>hive.support.concurrency</name>

<description>Enable Hive's Table Lock Manager Service</description>

<value>true</value>

</property>

6. To add hiveserver2 instance, Go to Service hive1- Instance Tab

a] Click on Add [This will Add Role Instance to hive1].

b] Check checkbox located below HiveServer2, click on Continue.

c] Role Instances are listed, Click on "hiveserver2". Click on Actions->Start this HiveServer2

HiveServer2 started.

From Cloudera Manager, Start All Services.

7. Copy the hive jar files located at "/usr/lib/hive/lib", to our ADS lib driver folder, by deleting old hive jar files.

[ Reference Link: https://www.aquaclusters.com/app/home/project/public/aquadatastudio/wikibook/Documentation14/page/Apache-Hive-JDBC-Drivers/Apache-Hive-JDBC-Drivers#cloudera ]

8. Start the ADS on cloudera VM.

Name: ClouderaHS2

Connection Type: HiveServer 2

Distribution : Cloudera

Host: localhost

Port: 10000

9a] Distribution: Cloudera

Click on Test Connection, it will show progress bar in Test Connection dialog box for indefinite time.

Press Cancel.

9b]Change Distribution: Apache

Click on Test Connection, "Successfully Connected to Database" message shown, save connection properties.

Expand database tree node, and create table, table created successfully.

Here are detailed steps, followed by me to start HiveServer2 on Cloudera Quickstart VM CDH4.4 [Hive 0.10]

1. Start the VM [Network:NAT], login to Cloudera Manager through browser, stop hive services.

2. From Service hive1-Configuration tab- Disable "HiveServer2 Enable Impersonation" property.

3. Create hive warehouse directory

>>sudo mkdir -p /user/hive/warehouse

>>sudo chmod 777 -R /user/hive/warehouse

4. To add property in hive-site.xml, open it

>>sudo gedit /etc/hive/conf/hive-site.xml

5. Copy the below property in hive-site.xml [Or refer hive-site.xml file attachment]

[ Reference Link: http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/4.2.0/CDH4-Installation-Guide/cdh4ig_topic_18_5.html ]

<property>

<name>hive.support.concurrency</name>

<description>Enable Hive's Table Lock Manager Service</description>

<value>true</value>

</property>

6. To add hiveserver2 instance, Go to Service hive1- Instance Tab

a] Click on Add [This will Add Role Instance to hive1].

b] Check checkbox located below HiveServer2, click on Continue.

c] Role Instances are listed, Click on "hiveserver2". Click on Actions->Start this HiveServer2

HiveServer2 started.

From Cloudera Manager, Start All Services.

7. Copy the hive jar files located at "/usr/lib/hive/lib", to our ADS lib driver folder, by deleting old hive jar files.

[ Reference Link: https://www.aquaclusters.com/app/home/project/public/aquadatastudio/wikibook/Documentation14/page/Apache-Hive-JDBC-Drivers/Apache-Hive-JDBC-Drivers#cloudera ]

8. Start the ADS on cloudera VM.

Name: ClouderaHS2

Connection Type: HiveServer 2

Distribution : Cloudera

Host: localhost

Port: 10000

9a] Distribution: Cloudera

Click on Test Connection, it will show progress bar in Test Connection dialog box for indefinite time.

Press Cancel.

9b]Change Distribution: Apache

Click on Test Connection, "Successfully Connected to Database" message shown, save connection properties.

Expand database tree node, and create table, table created successfully.

tariqrahiman 2014-03-18T19:24:53Z

From the email I had sent you and the steps described in your comment, I assume this issue is now fixed and you are able to connect successfully. Please close the issue if this is resolved

anilkalshetti 2014-03-19T04:10:52Z

Please look at point 9a] in the above given comment it says,

9a] Distribution: Cloudera

Click on Test Connection, it will show progress bar in Test Connection dialog box for indefinite time.

So when we have selected Distribution: Cloudera, we should be able to connect ADS to Hive server 2, but its not.

We have also copied jar files from Cloudera VM mentioned in our ADS Hive Connection Documentation, but still same issue occurs.

We have followed Cloudera documentation, for Hive Server 2 configuration.

tariqrahiman 2014-03-21T18:19:37Z

I am closing this as an Environment issue and will reopen if a customer complaints. Initially, Anil had reported that he is able to connect with ADS 15 and not with ADS 14. With the steps that we had given him in the documents, he is not able to connect with ADS 15 as well.

Will take this offline and discuss with Anil how to get them up and running

Search Tips

Aqua Data Studio / nhilam

Can't connect with HiveServer2 for Cloudera Distribution

3 attachments

Issue #11837

Completion

Search Tips

Aqua Data Studio / nhilam

Title

Can't connect with HiveServer2 for Cloudera Distribution

3 attachments

Issue #11837

Completion