#12108: Add support for Decimal datatype scale and precision when creating tables, by ADS visual editor - for ApacheHive0.13 -

anilkalshetti reported 2014-05-09T13:05:54Z · last modified 2014-11-04T17:54:04Z

Add support for Decimal datatype scale and precision when creating tables, by ADS visual editor - for ApacheHive0.13 -

Dev	tomconrad
QA	tariqrahiman

Priority	Low
Complexity	Unknown

Component	Hive
Version	16.0

Aqua Data Studio 15.0.0-dev-273
Build #: 37771
Built on: 2014-May-08 03:31:58 PM

Aqua Data Studio 14.0.13

Operating Environment: Ubuntu 13.04 LTS
Database: Apache Hive 0.13
Distribution: Apache
Java Version:   Java 1.7.0_51
[Apache Hadoop2.4, Hive 0.13, Distribution: Apache, Connection Type: Hiveserver1]

Issue:  Add support for Decimal datatype scale and precision when creating tables, by ADS visual editor - for ApacheHive0.13 -

Steps to reproduce:
1. Connect ADS to Apache Hive 0.13
2. Apache Hive 0.11 and 0.12 have the precision of the DECIMAL type fixed and limited to 38 digits. As of Hive 0.13 users can specify scale and precision when creating tables with the DECIMAL datatype using a DECIMAL(precision, scale)
Reference Link: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types

3. Create a table using the below script in Query Analyzer.

CREATE TABLE testDecimalPrecisionScale (

b DECIMAL(9, 7)

)

Go

4.Table gets created successfully.

5. Provide support in ADS Visual editor, create table, so user can specify scale and precision when creating tables with the 'DECIMAL' datatype

5 attachments

ApacheHive13-decimal.png

2014-05-09T13:05:54Z

326 KB
ApacheHive012.png

2014-06-30T13:06:24Z

251 KB
ApacheHive0131.png

2014-06-30T13:06:25Z

234 KB
ApacheHive013.png

2014-06-30T13:06:25Z

234 KB
ClouderaHive012.png

2014-06-30T13:06:25Z

277 KB

All Comments (13) Change History

tomconrad 2014-06-26T22:30:59Z

Also ADS 14.0.17-1

Hi Anil, I added in the precision and scale but I don't have a way to test it as I don't have version .13. Please let me know if it works OK? Thanks, Tom

anilkalshetti 2014-06-30T13:07:11Z

Build: ADS 15.0.0-dev-351

@Tom
For decimal Datatype the precision and scale fields are added, but the fields are disabled.
Please refer screenshots: ClouderaHive012.png, ApacheHive0131.png

tomconrad 2014-07-01T15:48:38Z

Also ADS 14.0.17-1

anilkalshetti 2014-07-02T12:38:37Z

Build : ADS 15.0.0-dev-361

Observations for different Hive distributions:

1]Connection Type: HiveServer 2
a] Apache Hive 0.13 - Working Properly - Pass
b] Hortonworks Hive 0.13 - Working Properly - Pass
c] MapR Hive 0.13- Working Properly- Pass
d] Cloudera Hive 0.12- will test again// Mail sent for mapping of Cloudera Hive 0.12 with Apache Hive 0.13 datatypes - Pending

2]Connection Type: HiveServer 1
a] Apache Hive 0.13 - For decimal datatype Precision and Scale fields are disabled. - Fail

tomconrad 2014-07-02T15:02:11Z

Hi Anil, I added support for Hive Server 1 decimal since we are going to provide the user with .13 datatypes as default - ADS 15.0.0-dev-363 and ADS 14.0.17-3 Thanks, Tom

anilkalshetti 2014-07-03T09:16:47Z

Verified in ADS 15.0.0-dev-363

Verified For:
Connection Type: HiveServer 1
a] Apache Hive 0.13 - Working Properly- Pass
b] Apache Hive 0.13.1 - Working Properly- Pass

anilkalshetti 2014-07-03T12:27:46Z

Build: ADS 15.0.0-dev-363
@Tom

I tested this issue for all previous Hive versions, few things need to take care for decimal datatype

1.
Distribution: Apache
Connection Type: HiveServer 1
a] Apache Hive 0.13.1- Precision and scale fields are enabled - Pass
b] Apache Hive 0.12-Precision and scale fields are enabled, Please disable them- Fail
c] Apache Hive 0.11-precision and scale options are enabled, Please disable them- Fail

Connection Type: HiveServer 2
a] Apache Hive 0.13.1- Precision and scale fields are enabled - Pass
b] Apache Hive 0.12-Precision and scale fields are disabled - Pass|
c] Apache Hive 0.11- Precision and scale fields are disabled- Pass

Note: All Apache Hive version 0.12 and below, Please Disable precision and scale options.
ER Diagram- precision and scale fields are not shown

2.
Distribution: Cloudera
Connection Type: HiveServer 2
a] Cloudera Hive 0.12- Precision and scale fields are disabled, Please enable this fields - Fail
ERD- Precision and scale options are not shown, Please show them and enable this fields

b] Cloudera Hive 0.10 -Precision and scale options are not shown- Pass

3.
Distribution: Hortonworks
Connection Type: HiveServer 2
a] Hortonworks Hive 0.13- Precision and scale fields are enabled - Pass
b] Hortonworks Hive 0.12-Precision and scale fields are disabled - Pass

4.
Distribution: Hortonworks
Connection Type: HiveServer 2
a] MapR Hive 0.12- Precision and scale fields are enabled - Pass
b] MapR Hive 0.11- Precision and scale fields are disabled - Pass|

tomconrad 2014-07-03T18:34:10Z

Hi Anil, These should be fixed in ADS 15.0.0-dev-366 and ADS 14.0.17-6.. Thanks, Tom

anilkalshetti 2014-07-07T08:37:32Z

Build: ADS 15.0.0-dev-366

Distribution: Apache

Connection Type: HiveServer 1

a] Apache Hive 0.13.1- Precision and scale fields are enabled - Pass

b] Apache Hive 0.12-Precision and scale fields are enabled, Please disable them- Fail

c] Apache Hive 0.11-precision and scale options are enabled, Please disable them- Fail

2.
Distribution: Cloudera , CDH5.0.2
Connection Type: HiveServer 2
a] Cloudera Hive 0.12- Precision and scale fields are disabled, Please enable this fields - Pass
ERD- Precision and scale options are not shown, Please show them and enable this fields

@Tom,
For Hiveserver1, as we've discussed earlier, that the code can't detect the version if ADS is connected with Hiveserver1, due to this limitation, should we ignore this[Fail] scenario?

and keep the above scenario as won't fix.

Let me know, what is your opinion on this.

tomconrad 2014-07-07T14:38:04Z

Hi Anil, You are correct.. We are going to default to version .13 for Hive Server 1 so will always get the precision and scale. We will consider this OK for now. Maybe in the future, distributions will provide better versioning.. Thanks, Tom

anilkalshetti 2014-07-08T04:33:21Z

Verified in ADS 15.0.0-dev-369

anilkalshetti 2014-07-22T09:49:13Z

Verified in ADS 14.0.18
and ADS 15.0.0-alpha-17

Please Close this issue

anilkalshetti 2014-11-04T10:22:41Z

Verified in ADS 16.0.0-dev-21

Tested this issue in below Hive Distributions

a] Apache Hive 0.13.1, Distribution: Apache, Connection Type: Hiveserver2

Apache Hive 0.13.1, Distribution: Apache, Connection Type: Hiveserver1

b] Hortonworks HDP2.1 Quickstart VM [Hive 0.13] , Distribution: Hortonworks, Connection Type: Hiveserver2

c] Cloudera Quickstart VM CDH5.2 [Hive 0.13.1] , Distribution: Cloudera, Connection Type: Hiveserver2

Search Tips

Aqua Data Studio / nhilam

Add support for Decimal datatype scale and precision when creating tables, by ADS visual editor - for ApacheHive0.13 -

5 attachments

Issue #12108

Completion

Search Tips

Aqua Data Studio / nhilam

Title

Add support for Decimal datatype scale and precision when creating tables, by ADS visual editor - for ApacheHive0.13 -

5 attachments

Issue #12108

Completion