#8788: ADS suspended when we try to import data for not supported data type in import

ranarohitp(*) reported Apr 30, 2013 · last modified Jun 7, 2013

ADS suspended when we try to import data for not supported data type in import

Dev	kin-hong
QA	tariqrahiman

Priority	Low
Complexity	Unknown

Component	Tools - Import Tool
Version	14.0

ADS version : ads-windows-x64-14.0-dev-44
Database:Sybase Anywhere 12/Sybase ASE15.7

Connect to Sybase Ase.
Create following table

CREATE TABLE Test_Datatype (
   c1   varchar(25) NULL,
   c2   varbinary(2) NULL,
   c3   UNSIGNED SMALLINT NULL,
   c4   UNSIGNED INT NULL,
   c5   UNSIGNED BIGINT NULL
   )
GO

Now go to Tools->Import Data->Connect to Sybase ASE 15.7->Import file(Use attached file),click next->From Schema and table drop down select respective values(above given table) and click next->In option tab from "Destination" drop down->choose "Import into database",click on next button->On Transaction tab set Transaction type:Batch,Batch size:1000,Threshold:0and wait time-1 and say next.This will throw error message over ADS window console.

Now click on previous button and go back till "General tab",and again import same file,repeat this procedure for 4 to 6 times and you should get null pointer exception message over "status tab".
This exception will hange the ADS and we need to kill the process from task manager.

Not producible with ADS 13

2 attachments

Loop.png

Apr 30, 2013

50 KB
dataset.txt

Apr 30, 2013

189 B

All (19) Comments Change History

ranarohitp(*) Apr 30, 2013 Change History

Field	Old Value	New Value
Description	ADS version : ads-windows-x64-14.0-dev-44 Database:Sybase Anywhere 12/Sybase ASE15.7 Connect to Sybase Ase. Create following table CREATE TABLE Test_Datatype ( c1 varchar(25) NULL, c2 varbinary(2) NULL, c3 UNSIGNED SMALLINT NULL, c4 UNSIGNED INT NULL, c5 UNSIGNED BIGINT NULL ) GO Use the attached script for importing data	ADS version : ads-windows-x64-14.0-dev-44 Database:Sybase Anywhere 12/Sybase ASE15.7 Connect to Sybase Ase. Create following table CREATE TABLE Test_Datatype ( c1 varchar(25) NULL, c2 varbinary(2) NULL, c3 UNSIGNED SMALLINT NULL, c4 UNSIGNED INT NULL, c5 UNSIGNED BIGINT NULL ) GO Now go to Tools->Import Data->Connect to Sybase ASE 15.7->Import file(Use attached file),click next->From Schema and table drop down select respective values(above given table) and click next->In option tab from "Destination" drop down->choose "Import into database",click on next button->On Transaction tab set Transaction type:Batch,Batch size:1000,Threshold:0and wait time-1 and say next.This will throw error message over ADS window console. Now click on previous button and go back till "General tab",and again import same file,repeat this procedure for 4 to 6 times and you should get null pointer exception message over "status tab".

Description

ADS version : ads-windows-x64-14.0-dev-44
Database:Sybase Anywhere 12/Sybase ASE15.7

Connect to Sybase Ase.
Create following table

CREATE TABLE Test_Datatype (
   c1   varchar(25) NULL,
   c2   varbinary(2) NULL,
   c3   UNSIGNED SMALLINT NULL,
   c4   UNSIGNED INT NULL,
   c5   UNSIGNED BIGINT NULL
   )
GO

Use the attached script for importing data

ADS version : ads-windows-x64-14.0-dev-44
Database:Sybase Anywhere 12/Sybase ASE15.7

Connect to Sybase Ase.
Create following table

CREATE TABLE Test_Datatype (
   c1   varchar(25) NULL,
   c2   varbinary(2) NULL,
   c3   UNSIGNED SMALLINT NULL,
   c4   UNSIGNED INT NULL,
   c5   UNSIGNED BIGINT NULL
   )
GO

Now click on previous button and go back till "General tab",and again import same file,repeat this procedure for 4 to 6 times and you should get null pointer exception message over "status tab".

ranarohitp(*) Apr 30, 2013 Change History

Field	Old Value	New Value
Component	App - AquaProjects	Tools - Import Tool
Description	ADS version : ads-windows-x64-14.0-dev-44 Database:Sybase Anywhere 12/Sybase ASE15.7 Connect to Sybase Ase. Create following table CREATE TABLE Test_Datatype ( c1 varchar(25) NULL, c2 varbinary(2) NULL, c3 UNSIGNED SMALLINT NULL, c4 UNSIGNED INT NULL, c5 UNSIGNED BIGINT NULL ) GO Now go to Tools->Import Data->Connect to Sybase ASE 15.7->Import file(Use attached file),click next->From Schema and table drop down select respective values(above given table) and click next->In option tab from "Destination" drop down->choose "Import into database",click on next button->On Transaction tab set Transaction type:Batch,Batch size:1000,Threshold:0and wait time-1 and say next.This will throw error message over ADS window console. Now click on previous button and go back till "General tab",and again import same file,repeat this procedure for 4 to 6 times and you should get null pointer exception message over "status tab".	ADS version : ads-windows-x64-14.0-dev-44 Database:Sybase Anywhere 12/Sybase ASE15.7 Connect to Sybase Ase. Create following table CREATE TABLE Test_Datatype ( c1 varchar(25) NULL, c2 varbinary(2) NULL, c3 UNSIGNED SMALLINT NULL, c4 UNSIGNED INT NULL, c5 UNSIGNED BIGINT NULL ) GO Now go to Tools->Import Data->Connect to Sybase ASE 15.7->Import file(Use attached file),click next->From Schema and table drop down select respective values(above given table) and click next->In option tab from "Destination" drop down->choose "Import into database",click on next button->On Transaction tab set Transaction type:Batch,Batch size:1000,Threshold:0and wait time-1 and say next.This will throw error message over ADS window console. Now click on previous button and go back till "General tab",and again import same file,repeat this procedure for 4 to 6 times and you should get null pointer exception message over "status tab". This exception will hange the ADS and we need to kill the process from task manager.
Dev Assignee	Unassigned	SachinPrakash (Sachin Prakash)
QA Assignee	Unassigned	tariqrahiman (Tariq Rahiman)
Summary	ADS stalls when try to import file with not supported data type	ADS suspended when we try to import not supported data type
Version	Future - .9	14.0

ranarohitp(*) Apr 30, 2013 Change History

Field	Old Value	New Value
Description	ADS version : ads-windows-x64-14.0-dev-44 Database:Sybase Anywhere 12/Sybase ASE15.7 Connect to Sybase Ase. Create following table CREATE TABLE Test_Datatype ( c1 varchar(25) NULL, c2 varbinary(2) NULL, c3 UNSIGNED SMALLINT NULL, c4 UNSIGNED INT NULL, c5 UNSIGNED BIGINT NULL ) GO Now go to Tools->Import Data->Connect to Sybase ASE 15.7->Import file(Use attached file),click next->From Schema and table drop down select respective values(above given table) and click next->In option tab from "Destination" drop down->choose "Import into database",click on next button->On Transaction tab set Transaction type:Batch,Batch size:1000,Threshold:0and wait time-1 and say next.This will throw error message over ADS window console. Now click on previous button and go back till "General tab",and again import same file,repeat this procedure for 4 to 6 times and you should get null pointer exception message over "status tab". This exception will hange the ADS and we need to kill the process from task manager.	ADS version : ads-windows-x64-14.0-dev-44 Database:Sybase Anywhere 12/Sybase ASE15.7 Connect to Sybase Ase. Create following table CREATE TABLE Test_Datatype ( c1 varchar(25) NULL, c2 varbinary(2) NULL, c3 UNSIGNED SMALLINT NULL, c4 UNSIGNED INT NULL, c5 UNSIGNED BIGINT NULL ) GO Now go to Tools->Import Data->Connect to Sybase ASE 15.7->Import file(Use attached file),click next->From Schema and table drop down select respective values(above given table) and click next->In option tab from "Destination" drop down->choose "Import into database",click on next button->On Transaction tab set Transaction type:Batch,Batch size:1000,Threshold:0and wait time-1 and say next.This will throw error message over ADS window console. Now click on previous button and go back till "General tab",and again import same file,repeat this procedure for 4 to 6 times and you should get null pointer exception message over "status tab". This exception will hange the ADS and we need to kill the process from task manager. Not producible with ADS 13

Description

ADS version : ads-windows-x64-14.0-dev-44
Database:Sybase Anywhere 12/Sybase ASE15.7

Connect to Sybase Ase.
Create following table

CREATE TABLE Test_Datatype (
   c1   varchar(25) NULL,
   c2   varbinary(2) NULL,
   c3   UNSIGNED SMALLINT NULL,
   c4   UNSIGNED INT NULL,
   c5   UNSIGNED BIGINT NULL
   )
GO

ADS version : ads-windows-x64-14.0-dev-44
Database:Sybase Anywhere 12/Sybase ASE15.7

Connect to Sybase Ase.
Create following table

CREATE TABLE Test_Datatype (
   c1   varchar(25) NULL,
   c2   varbinary(2) NULL,
   c3   UNSIGNED SMALLINT NULL,
   c4   UNSIGNED INT NULL,
   c5   UNSIGNED BIGINT NULL
   )
GO

Not producible with ADS 13

ranarohitp(*) Apr 30, 2013 Change History

Field	Old Value	New Value
Summary	ADS suspended when we try to import not supported data type	ADS suspended when we try to import data dor not supported data type in import

ranarohitp(*) Apr 30, 2013 Change History

Field	Old Value	New Value
Summary	ADS suspended when we try to import data dor not supported data type in import	ADS suspended when we try to import data for not supported data type in import

SachinPrakash Apr 30, 2013 Change History

Field	Old Value	New Value
Dev Assignee	SachinPrakash (Sachin Prakash)	kin-hong (Kin-Hong Wong)

SachinPrakash May 14, 2013 Change History

Field	Old Value	New Value
Dev Assignee	kin-hong (Kin-Hong Wong)	funfun (Fun Fun)

funfun May 19, 2013 Comment

I was not able to reproduce this problem by following the steps described and using the same test data file. I repeated the test 10+ times and data was successfully inserted without any problem. The only exception I encountered is included below, not sure if it makes difference.

<2013-05-18 19:06:24,968> ERROR [import] <com.aquafold.datastudio.tools.importtool.ImportThread> Prepared statement failed, fallback to insert statement.
java.sql.SQLException: JZ0SJ: Metadata accessor information was not found on this database. Please install the required tables as mentioned in the jConnect documentation.
   at com.sybase.jdbc4.jdbc.SybConnection.getAllExceptions(SybConnection.java:2780)
   at com.sybase.jdbc4.jdbc.SybStatement.handleSQLE(SybStatement.java:2665)
   at com.sybase.jdbc4.jdbc.SybPreparedStatement.prepareBCP(SybPreparedStatement.java:3427)
   at com.sybase.jdbc4.jdbc.SybPreparedStatement.<init>(SybPreparedStatement.java:209)
   at com.sybase.jdbc4.jdbc.SybConnection.prepareStatement(SybConnection.java:1406)
   at com.sybase.jdbc4.jdbc.SybConnection.prepareStatement(SybConnection.java:1307)
   at com.sybase.jdbc4.jdbc.SybConnection.prepareStatement(SybConnection.java:1278)
   at com.aquafold.aquacore.scripts.WrapperConnection.prepareStatement(WrapperConnection.java:64)
   at com.aquafold.datastudio.tools.importtool.ImportThread.process(ImportThread.java:258)
   at com.aquafold.datastudio.tools.importtool.ImportThread.run(ImportThread.java:98)

NielsGron May 20, 2013 Comment

This can be multiple things ...

1. ADS could be running out of memory. Please reproduce and attached application log to verify memory exception.

2. The Sybase transaction log could fill up and this blocks any transaction which makes it look like ADS is locked up. You can use the "

dump tran[saction] database_name

command.

This can be multiple things ...

1. ADS could be running out of memory. Please reproduce and attached application log to verify memory exception.

2. The Sybase transaction log could fill up and this blocks any transaction which makes it look like ADS is locked up. You can use the "

dump tran[saction] database_name

command.

NielsGron May 20, 2013 Change History

Field	Old Value	New Value
Dev Assignee	funfun (Fun Fun)	swissarmyknife(*) (Jonathan Powers)

swissarmyknife(*) May 21, 2013 Comment

I've tried more than 10 times on

Version: 14.0.0-alpha-21

Build #: 32492

Build Date: 2013-May-19 10:30:16 AM

Operating Environment: Windows XP (5.2, amd64) / Cp1252 / en / US / Sun Microsystems Inc. 1.6.0_43-b01

Memory: Max=891,092,992; Total=397,803,520; Free=194,170,216; CPUs=8

and can't reproduce.

tariqrahiman May 21, 2013 Comment

This can be reproduced with the steps in 8801. See Ivans notes

preparedstatement fails -- connection goes into inconsistant state. At this point the connection is messed up yet datastudio doesn't know. If the user tries to go back and change it to full we get the type 7 error at:

importThread.java

line 214:conn.setAutoCommit(is.txType == TransactionTypeProperty.FULL_TRANSACTION);

The connection would need to be reconnected to get this to work. To make matters worse if the user goes all the way back, we try to reaquire the table from the connection and get null. This null is not handled well and DataStudio goes into an endless loop of null pointers that will lock DataStudio up.

SachinPrakash May 21, 2013 Change History

Field	Old Value	New Value
Dev Assignee	swissarmyknife(*) (Jonathan Powers)	SachinPrakash (Sachin Prakash)

SachinPrakash May 24, 2013 Change History

Field	Old Value	New Value
Dev Assignee	SachinPrakash (Sachin Prakash)	kin-hong (Kin-Hong Wong)

SachinPrakash May 24, 2013 Comment

@kin-hong: As Tariq mentions, try the steps mentioned in #8801 -- you'll get an ArrayOutOfBoundException. Then, hit the "Previous" button until you're on step 1 of the import wizard. Then click on "Next" so that you're on step 2. Notice that the table's columns are not displayed. 2 items to point out:

1) B/c the table's columns are not populated, if you continue to press "Next" and start the import process, you'll get into a loop of processing the same record over & over again.

To fix this, we need to add "record = null" as show below:

finally {

AQCommonUtils.close(stmt);

record = null;

}

The second problem is what Ivan describes -- any query executed on this connection returns an error message. Maybe its due to some improper cleanup of preparedStatement usage? Please go ahead & investigate this.

kin-hong May 28, 2013 Change History

Field	Old Value	New Value
Resolution		Fixed
Resolved Date		May 28, 2013 8:33 PM
Status	New	Resolved

kin-hong May 28, 2013 Comment

The ADS endless loop (suspended) problem is now fixed.

It seems that after the ArrayOutOfBoundException has been thrown by the Sybase JDBC driver, the database connection is no longer valid (the Connection#isValid(0) method return false). At this point, the connection is no longer usable. For the GUI import tool, we now display a message telling user to close the import tool. For FluidShell, we display a message telling user to reconnect.

ranarohitp(*) Jun 7, 2013 Change History

Field	Old Value	New Value
Status	Resolved	Closed

ranarohitp(*) Jun 7, 2013 Comment

Verified for Windows using : ads-windows-x64-14.0.0-beta-14

Search Tips

Aqua Data Studio / nhilam

ADS suspended when we try to import data for not supported data type in import

2 attachments

Issue #8788

Completion

2 issue links

Issue #8801

Issue #8801

Search Tips

Aqua Data Studio / nhilam

Title

ADS suspended when we try to import data for not supported data type in import

2 attachments

Issue #8788

Completion

2 issue links

Issue #8801

Issue #8801