#13479: Cloudera Impala- Insert query shows error message java.lang.OutOfMemoryError: Java heap space

anilkalshetti reported 2015-07-13T11:52:57Z · last modified 2015-08-17T14:47:47Z

Cloudera Impala- Insert query shows error message java.lang.OutOfMemoryError: Java heap space

Dev	tomconrad
QA	SachinPrakash

Priority	Major
Complexity	Unknown

Component	Hive
Version	17.0

Aqua Data Studio 17.0.0-dev-76
Build #: 44689
Built on: 2015-Jul-10 05:19:20 PM
ADS RAM: 4GB

OS: Ubuntu 14.04 LTE
Linux (3.13.0-55-generic, amd64) / UTF-8 / en / IN / Oracle Corporation 1.8.0_40-b26
Memory: Max=4,433,379,328; Total=1,329,070,080; Free=986,494,304; CPUs=8Database: Cloudera CDH 5.4.0 - Impala 2.2.0

Driver: Type: JDBC41- CDH5.4.0_Impala_JDBC41_v2.5.22-1040-GA
JDBC4- CDH5.4.0_Impala_JDBC4_V-2-5-22-1040-GA

Drivers downloaded from-Link

Distribution : Cloudera

Connection Type: Impala

Issue: Cloudera Impala- Insert query shows error message java.lang.OutOfMemoryError: Java heap space

Steps to reproduce issue:

Copy the Impala jdbc41 drivers in ADS- /datastudio/lib/drivers directory.
In ADS, launch a new server registration dialog
Choose "Apache Hive" as the server type, Select 'Connection type' as Impala. Click on Save.
Open Query Analyzer, and execute below commands.

create table r1 (x real)

describe r1

insert into r1 values (1.5), (cast (2.2 as double))

// For insert query ADS shows error message

//Please refer Screenshot1-CDH540.png

Observation:
When same insert query executed from Hue-Impala Editor- WebUI, it inserted record properly. crosschecked result running select query from ADS.

//Please refer screenshot2-ImpalaEditor-Hue-WebUI.png

SQL Log: Message-

java.lang.OutOfMemoryError: Java heap space

at java.util.Arrays.copyOf(Arrays.java:3332)

at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:137)

at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:121)

at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:421)

at java.lang.StringBuilder.append(StringBuilder.java:136)

at com.cloudera.impala.querytranslation.ImpalaQLAENodeVisitor.visit(Unknown Source)

at com.cloudera.sqlengine.aeprocessor.aetree.relation.AETableConstructor.acceptVisitor(Unknown Source)

at com.cloudera.impala.querytranslation.ImpalaQLAENodeVisitor.visit(Unknown Source)

at com.cloudera.sqlengine.aeprocessor.aetree.statement.AEInsert.acceptVisitor(Unknown Source)

at com.cloudera.impala.querytranslation.ImpalaQueryTranslator.translate(Unknown Source)

at com.cloudera.hivecommon.dataengine.HiveJDBCDSIExtQueryExecutor.execute(Unknown Source)

at com.cloudera.jdbc.common.SStatement.executeNoParams(Unknown Source)

at com.cloudera.jdbc.common.SStatement.execute(Unknown Source)

at com.aquafold.aquacore.open.rdbms.drivers.hive.Oꀩᡅ̏⡕5short.execute(Unknown Source)

at \\.\\.\\हिñçêČάй語简�?한\\.F̨ꑖ͌⠴newclass.execute(Unknown Source)

at \\.\\.\\हिñçêČάй語简�?한\\.S᠆ꒇᚼᡨenum.a(Unknown Source)

at com.aquafold.datastudio.queryanalyzer.V⢌ꌣꌝꅯ.run(Unknown Source)

5 attachments

Screenshot2-ImpalaEditor-Hue-WebUI.png

2015-07-13T11:52:57Z

177 KB
Screenshot1-CDH540.png

2015-07-13T11:52:57Z

142 KB
beeline-interface.png

2015-07-24T07:47:34Z

39 KB
beeline-interface-2.png

2015-07-24T07:49:59Z

55 KB
beeline-interface-3.png

2015-07-24T07:57:49Z

119 KB

All Comments (7) Change History

anilkalshetti 2015-07-14T13:22:38Z · (edited)

@Tariq:

Please find below queries, which helps for issue analysis.

create table heroes (name string, era string, planet string)

//'insert into' command with multiple comma separated parenthesis values , causes java heap space error

insert into heroes values ('Tesla','20th century','Earth'), ('Pythagoras','Antiquity','Earth'), ('Zopzar','Far Future','Mars')

//Instead 'into', using 'overwrite' keyword, makes the query execute successfully.

//but using overwrite, it will overwrite the previous records

insert overwrite heroes values ('Tesla','20th century','Earth'), ('Pythagoras','Antiquity','Earth'), ('Zopzar','Far Future','Mars')

select * from heroes

SachinPrakash 2015-07-23T18:35:21Z

Pls try w/ beeline & report the results.

anilkalshetti 2015-07-24T07:59:38Z · (edited)

@Sachin:

Beeline interface - Insert records into table, using insert command.

Please refer screenshot: beeline-interface.png, beeline-interface-2.png, beeline-interface-3.png for different examples.

In beeline-interface-3.png , ADS displayed proper result for select * query , while impala beeline interface displays only 1st column in result for same query.

SachinPrakash 2015-08-11T04:33:09Z

Does this work if you set the AuthMech=0?

anilkalshetti 2015-08-11T04:38:13Z

The Driver Parameter is already set to AuthMech=0.
Still the issue occurs.

tomconrad 2015-08-11T15:47:55Z

Hi Team, This works correctly with the Apache drivers so I suspect that beeline will also work correctly. It is a problem with the newer Cloudera Connector drivers. I tested an older version of the Cloudera Connector driver and there was no exception. I also checked for open issues against this error and could not find anything. I think we should resolve this issue as "won't fix". Anil, Sachin, Thoughts on this?? Thanks, Tom

SachinPrakash 2015-08-11T16:16:24Z

Marking as Won't Fix based upon Tom's analysis.

Search Tips

Aqua Data Studio / nhilam

Cloudera Impala- Insert query shows error message java.lang.OutOfMemoryError: Java heap space

5 attachments

Issue #13479

Completion

Search Tips

Aqua Data Studio / nhilam

Title

Cloudera Impala- Insert query shows error message java.lang.OutOfMemoryError: Java heap space

5 attachments

Issue #13479

Completion