#8801: java.lang.ArrayIndexOutOfBoundsException

ranarohitp(*) reported 2013-05-02T09:06:25Z · last modified 2013-06-07T09:04:49Z

java.lang.ArrayIndexOutOfBoundsException

Dev	SachinPrakash
QA	tariqrahiman

Priority	Low
Complexity	Unknown

Component	Tools - Import Tool
Version	14.0

ADS version : ads-windows-x64-14.0-dev-44
Database:Sybase Anywhere 12/Sybase ASE15.7

Create following table

CREATE TABLE dbo.Test_univarchar (
col1 univarchar(10) NULL
)
GO

Now go to Tools->Import Data->Connect to Sybase ASE 15.7->Import file(Use attached file Exp.txt),click next->From Schema and table drop down select respective values and click next->In option tab from "Destination" drop down->choose "Import into database",click on next button->On Transaction tab set Transaction type:Batch,Batch size:1000,Threshold:0and wait time-1 and say next.This will throw ArrayIndexOutOfBoundsException over ADS window console.

This does not occur in ADS 13.0 rc-4

4 attachments

Import_unichar.png

2013-05-02T09:08:47Z

34 KB
Exp.txt

2013-05-02T09:09:29Z

26 B
ArrayIndexOutOfBoundsException in datastudio.log

2013-05-20T23:06:05Z

11 KB
v14-0-0-alpha-21

2013-05-20T23:10:33Z

116 KB

All Comments (14) Change History

ranarohitp(*) 2013-05-02T09:22:21Z

Failed for unichar data type in ADS 14,work fine in ADS 13

CREATE TABLE dbo.Test_unichar (
col1 unichar(10) NULL
)
GO

kin-hong 2013-05-02T21:06:57Z

This seems to be a Sybase JDBC driver bug. I tried using PreparedStatement's setNString(), setString(), setNCharacterStream() method, they all result in the same exception

NielsGron 2013-05-02T21:26:36Z · (edited)

See here :
http://infocenter.sybase.com/help/index.jsp?topic=/com.sybase.infocenter.dc39001.0605/html/prjdbc/BHCFJECE.htm

You could try to set the Server Registration->Advanced->Charset=UTF8

We could also downdrop the driver to jConnect 6 and see if it works in there. If it works, then we could report a bug with jConnect 7.

We are expecting a new jConnect 7 build in the next few weeks with other fixes.

kin-hong 2013-05-02T22:57:08Z

1. I tried Server Registration->Advanced->Charset=UTF8, same problem

2. I tried using jConnect 6, ADS could not get a prepared statement, exception below:

java.lang.NullPointerException

at com.sybase.jdbc3.jdbc.SybBCP.<init>(Unknown Source)

at com.sybase.jdbc3.jdbc.SybPreparedStatement.a(Unknown Source)

at com.sybase.jdbc3.jdbc.SybPreparedStatement.<init>(Unknown Source)

at com.sybase.jdbc3.jdbc.SybConnection.a(Unknown Source)

at com.sybase.jdbc3.jdbc.SybConnection.prepareStatement(Unknown Source)

at com.aquafold.aquacore.scripts.WrapperConnection.prepareStatement(WrapperConnection.java:55)

at com.aquafold.datastudio.tools.importtool.ImportThread.process(ImportThread.java:256)

at com.aquafold.datastudio.tools.importtool.ImportThread.run(ImportThread.java:96)

NielsGron 2013-05-03T00:33:54Z · (edited)

Does this error still occur if you used a prepared statement, but disable the ENABLE_BULK_LOAD driver parameter?

If you look at the stack trace the exception is thrown by the SybBCP class, so it might just be the BCP which is Bulk Copy.

funfun 2013-05-17T04:30:24Z

Hi Tariq,

Can you please try this test case as well?

Same as issue #8799, by following the same test steps and using the same data file, I was not able to reproduce the error against the Sybase ASE 15.0 server running on xx.xxx.11.46. Data is truncated and successfully inserted to the database with the following message logged:

<2013-05-16 21:27:50,359> ERROR [import] <com.aquafold.datastudio.tools.importtool.ImportThread> Prepared statement failed, fallback to insert statement.
java.sql.SQLException: JZ0SJ: Metadata accessor information was not found on this database. Please install the required tables as mentioned in the jConnect documentation.
   at com.sybase.jdbc4.jdbc.SybConnection.getAllExceptions(SybConnection.java:2780)
   at com.sybase.jdbc4.jdbc.SybStatement.handleSQLE(SybStatement.java:2665)
   at com.sybase.jdbc4.jdbc.SybPreparedStatement.prepareBCP(SybPreparedStatement.java:3427)
   at com.sybase.jdbc4.jdbc.SybPreparedStatement.<init>(SybPreparedStatement.java:209)
   at com.sybase.jdbc4.jdbc.SybConnection.prepareStatement(SybConnection.java:1406)
   at com.sybase.jdbc4.jdbc.SybConnection.prepareStatement(SybConnection.java:1307)
   at com.sybase.jdbc4.jdbc.SybConnection.prepareStatement(SybConnection.java:1278)
   at com.aquafold.aquacore.scripts.WrapperConnection.prepareStatement(WrapperConnection.java:64)
   at com.aquafold.datastudio.tools.importtool.ImportThread.process(ImportThread.java:258)
   at com.aquafold.datastudio.tools.importtool.ImportThread.run(ImportThread.java:98)

swissarmyknife(*) 2013-05-20T23:02:32Z

I replicated and will attach my logs in a moment.

Import started ...

java.lang.ArrayIndexOutOfBoundsException

at java.lang.System.arraycopy(Native Method)

at com.sybase.jdbc4.tds.BCPToken.write(BCPToken.java:2413)

at com.sybase.jdbc4.tds.BCPToken.writeParam(BCPToken.java:2117)

at com.sybase.jdbc4.tds.BCPToken.writeTdsBcpCol(BCPToken.java:1939)

at com.sybase.jdbc4.tds.BCPToken.writeVariableColumn(BCPToken.java:1155)

at com.sybase.jdbc4.tds.BCPToken.writeAPL(BCPToken.java:1037)

at com.sybase.jdbc4.tds.BCPToken.writeBulkData(BCPToken.java:330)

at com.sybase.jdbc4.tds.Tds.sendBulkData(Tds.java:5244)

at com.sybase.jdbc4.jdbc.SybBCP.bcpSendRow(SybBCP.java:1140)

at com.sybase.jdbc4.jdbc.SybPreparedStatement.executeBulkBatch(SybPreparedStatement.java:1684)

at com.sybase.jdbc4.jdbc.SybPreparedStatement.executeBatch(SybPreparedStatement.java:1722)

at \\...\\ .\\हिñçêČάй語简�?한\\.xꌒꉰ͓ꃏ.executeBatch(Unknown Source)

at \\...\\ .\\हिñçêČάй語简�?한\\.Rꆝ⡲͓ꃆ private return.process(Unknown Source)

at \\...\\ .\\हिñçêČάй語简�?한\\.Rꆝ⡲͓ꃆ private return.run(Unknown Source)

Import failed.

tariqrahiman 2013-05-21T00:01:18Z

I am also able to reproduce this error in ADS 14.0.0-alpha-21 for Adaptive Server Enterprise/15.5/EBF 17218

funfun 2013-05-21T03:12:03Z

OK, I can reproduce it on Sybase ASE 15.5 running on 11.57 but not on 11.46 which is Sybase ASE 15.0, here is the error message:

<2013-05-20 20:13:26,093> ERROR [import] <com.aquafold.datastudio.tools.importtool.ImportThread>
java.lang.ArrayIndexOutOfBoundsException
   at java.lang.System.arraycopy(Native Method)
   at com.sybase.jdbc4.tds.BCPToken.write(BCPToken.java:2413)
   at com.sybase.jdbc4.tds.BCPToken.writeParam(BCPToken.java:2117)
   at com.sybase.jdbc4.tds.BCPToken.writeTdsBcpCol(BCPToken.java:1939)
   at com.sybase.jdbc4.tds.BCPToken.writeVariableColumn(BCPToken.java:1155)
   at com.sybase.jdbc4.tds.BCPToken.writeAPL(BCPToken.java:1037)
   at com.sybase.jdbc4.tds.BCPToken.writeBulkData(BCPToken.java:330)
   at com.sybase.jdbc4.tds.Tds.sendBulkData(Tds.java:5244)
   at com.sybase.jdbc4.jdbc.SybBCP.bcpSendRow(SybBCP.java:1140)
   at com.sybase.jdbc4.jdbc.SybPreparedStatement.executeBulkBatch(SybPreparedStatement.java:1684)
   at com.sybase.jdbc4.jdbc.SybPreparedStatement.executeBatch(SybPreparedStatement.java:1722)
   at com.aquafold.aquacore.scripts.WrappedStatement.executeBatch(WrappedStatement.java:150)
   at com.aquafold.datastudio.tools.importtool.ImportThread.process(ImportThread.java:467)
   at com.aquafold.datastudio.tools.importtool.ImportThread.run(ImportThread.java:98)

ivangron 2013-05-21T18:16:06Z · (edited)

preparedstatement fails -- connection goes into inconsistant state. At this point the connection is messed up yet datastudio doesn't know. If the user tries to go back and change it to full we get the type 7 error at:

importThread.java

line 214:conn.setAutoCommit(is.txType == TransactionTypeProperty.FULL_TRANSACTION);

The connection would need to be reconnected to get this to work. To make matters worse if the user goes all the way back, we try to reaquire the table from the connection and get null. This null is not handled well and DataStudio goes into an endless loop of null pointers that will lock DataStudio up.

Recommend we do not use preparedstatements if we can't fix this driver issue.

A.) OR we could extract the actual column length and while building the prepared statement data, truncate the data ourselves.

SachinPrakash 2013-05-24T00:39:11Z

Several issues that we need to investigate:

-- ArrayIndexOutOfBoundException - this is caused by the data being larger than what the declared data type can handle

-- Seems to be bug in our code that once the out of bounds exception is thrown on this single record file, our code goes into a loop where it keeps on try to process the same record over & over again

-- We're setting ENABLE_BULK_LOAD=true. However, the various documented options are listed here: http://infocenter.sybase.com/help/index.jsp?topic=/com.sybase.infocenter.dc32179.0707/html/jconnig/title.htm - We should do some testing to determine which one works best in our case

-- Take a look at: http://www.sybase.com/content/1026310/unicode_support_wp.pdf This discusses the various Java objects we can use to insert unichar data:

Java Interoperability:

The internal JDBC driver has been modified to efficiently transfer UNICHAR data between the SQL

and the Java contexts.

Going from SQL to Java, the class java.sql.ResultSet provides a number of “get”methods to retrieve

data from the columns of a result set. Any of these will work with columns defined as UNICHAR or

UNIVARCHAR. The method getString()is particularly efficient since no conversion whatsoever needs

to be performed – Java strings are already in Unicode!

Going from Java to SQL should be done using the setString() method of the class

java.sql.PreparedStatement. The internal JDBC driver will copy Java string data directly into the SQL

parameter defined as UNICHAR or UNIVARCHAR.

The external JDBC driver (jConnect) has been modified to support the same seamless interface as the

internal driver.

SachinPrakash 2013-05-24T14:24:54Z · (edited)

For JConnect 6.x: Unitext data is not supported with ENBALE_BULK_LOAD turned on:

http://infocenter.sybase.com/help/topic/com.sybase.infocenter.dc39001.0605/html/prjdbc/CIHHGIBA.htm?resultof=%22%62%63%70%22%20%22%69%6e%73%65%72%74%22%20

However, we bundle JConnect 7.07. For 7.07, there is no mention of not supporting unitext. Also, in 7.07, you should not set ENBALE_BULK_LOAD to "true". Instead, it should be set to one of these values:

ARRAYINSERT_WITH_MIXED_STATEMENTS, ARRAYINSERT, BCP, LOG_BCP

http://infocenter.sybase.com/help/topic/com.sybase.infocenter.dc39001.0707/html/prjdbc0707/CIHHGIBA.htm?resultof=%22%62%63%70%22%20%22%69%6e%73%65%72%74%22%20

SachinPrakash 2013-06-05T15:55:30Z

#8788 has resolved this issue.

ranarohitp(*) 2013-06-07T09:04:30Z

Verified for Windows using : ads-windows-x64-14.0.0-beta-14

Search Tips

Aqua Data Studio / nhilam

java.lang.ArrayIndexOutOfBoundsException

4 attachments

Issue #8801

Completion

5 issue links

Issue #8788

Issue #8799

Issue #8757

Issue #8799

Issue #8788

Search Tips

Aqua Data Studio / nhilam

Title

java.lang.ArrayIndexOutOfBoundsException

4 attachments

Issue #8801

Completion

5 issue links

Issue #8788

Issue #8799

Issue #8757

Issue #8799

Issue #8788