I connect to our Hive database using Spark SQL connection type with ADS, and when I expand databases, I can see them all. But when I try viewing tables within a database, most databases do no show the tables that do exist there. One database also generates an error when expanding the tables list. The attached document shows what I see in ADS, as well as what I've done in the MapR spark-sql command line to verify which databases and tables do exist. If it helps to debug I can show exactly which databases don't have the issue, which seems to be 2 or 3 of them.
Are these known issues with the ADS interface not being able to show / traverse all databases and tables?
![]() |
173 KB
|
68 KB
|
180 KB
Hi Tom, thanks for the help, but I am still having the issue. I went through the steps to download the 4 hive jarfiles specific to MapR from these locations, as we are running v0.13 of Hive.
http://mvnrepository.com/artifact/org.apache.hive/hive-exec/0.13.0
http://mvnrepository.com/artifact/org.apache.hive/hive-jdbc/0.13.0
http://mvnrepository.com/artifact/org.apache.hive/hive-metastore/0.13.0
http://mvnrepository.com/artifact/org.apache.hive/hive-service/0.13.0
I closed ADS, moved off the original jarfiles to a directory outside the ADS app install, moved the downloaded files to replace those (I did not rename them to remove the version number, as that wasn't mentioned in the steps). Then I restarted ADS, verified the distro used is still MapR on my connection, tested, and have the same issues.
I ran the SHOW TABLE... statement, but nothing ever showed in the results, even for those database that DO show tables in ADS, which is strange.
Thanks.
Paul
Hi Tom, thanks for the help, but I am still having the issue. I went through the steps to download the 4 hive jarfiles specific to MapR from these locations, as we are running v0.13 of Hive.
http://mvnrepository.com/artifact/org.apache.hive/hive-exec/0.13.0
http://mvnrepository.com/artifact/org.apache.hive/hive-jdbc/0.13.0
http://mvnrepository.com/artifact/org.apache.hive/hive-metastore/0.13.0
http://mvnrepository.com/artifact/org.apache.hive/hive-service/0.13.0
I closed ADS, moved off the original jarfiles to a directory outside the ADS app install, moved the downloaded files to replace those (I did not rename them to remove the version number, as that wasn't mentioned in the steps). Then I restarted ADS, verified the distro used is still MapR on my connection, tested, and have the same issues.
I ran the SHOW TABLE... statement, but nothing ever showed in the results, even for those database that DO show tables in ADS, which is strange.
Thanks.
Paul
Hi Tom, it seems part of the problem (the parquet error) was solved when we upgrade to Hive 1.2. Now we still see the issue of some tables not being visible in the navigation tree, and it looks to be the case for tablename longer than 25 characters. When I create a table in Hive or Beeline longer than 25 char, it doesn't appear in ADS, but when I run the create table command in ADS, the table does appear in the tree. Can you test this on your end by creating a 26+ char tablename from ADS AND command line Beeline or Hive? Thanks. Paul
Hi Tom, it seems part of the problem (the parquet error) was solved when we upgrade to Hive 1.2. Now we still see the issue of some tables not being visible in the navigation tree, and it looks to be the case for tablename longer than 25 characters. When I create a table in Hive or Beeline longer than 25 char, it doesn't appear in ADS, but when I run the create table command in ADS, the table does appear in the tree. Can you test this on your end by creating a 26+ char tablename from ADS AND command line Beeline or Hive? Thanks. Paul
Hi Paul, I created a table in Beeline with greater than 25 characters and was able to see it inside of the ADS schema tree. See attached screen shot. Would you please share your create statement and I can give that a try? Thanks, Tom
Hi Paul, I created a table in Beeline with greater than 25 characters and was able to see it inside of the ADS schema tree. See attached screen shot. Would you please share your create statement and I can give that a try? Thanks, Tom
Hi Paul, Would you also run the Show Tables command in a Query Analyzer window to see if the table is in the output? Thank you, Tom
Hi Paul, Would you also run the Show Tables command in a Query Analyzer window to see if the table is in the output? Thank you, Tom
Actually I was wrong about beeline. It's seemed to only be Hive CLI that had the issue, but today even that seems to be working fine. We have some older created tables that aren't visible, but it seems those have no owner, so that may be the problem. It's a test env so we'll just be sure that any created tables through any interface are visible before we progress. Thanks, all set!
Actually I was wrong about beeline. It's seemed to only be Hive CLI that had the issue, but today even that seems to be working fine. We have some older created tables that aren't visible, but it seems those have no owner, so that may be the problem. It's a test env so we'll just be sure that any created tables through any interface are visible before we progress. Thanks, all set!
Hi Paul, Good to hear. Let us know if you have other issues. Thanks, Tom
Hi Paul, Good to hear. Let us know if you have other issues. Thanks, Tom
Issue #14314 |
Closed |
Fixed |
Resolved |
Completion |
No due date |
No fixed build |
No time estimate |