Hi Sachin,  For issue 1, should we make Impala also check owner=null for consistency? Thanks, Tom

Hi Sachin,  For issue 1, should we make Impala also check owner=null for consistency? Thanks, Tom

@tom: yes.

For issue 2 and 3  It appears that MapR Impala does not return the column information using the Describe Formatted command as Cloudera Impala or H2 does. This can be tested by connecting to your MapR Impala server and executing a Describe Formatted command against a table. See attached example:

Hi Tariq, Please have your team thoroughly test any table/column scenario using Impala under MapR. These scenario's include schema tree, create/alter table with preview, table properties, schema generator, scripting, ERM, QB and anything else that you guys think could be affected by this change. They should also regression test all of the above scenarios across all distributions of h2, Impala and Spark. Please make this a priority as a patch needs to go to the customer by next week(assuming Sachin is ok with this priority shift).

Just for clarity of the failing issues..

1) Hive server 2  is not displaying tables in the schema tree when an external table has owner = null where Impala does display these since it is looking for external tables and not owner. 

This issue was a problem with the customer table. Their table had owner=null. For H2, ADS checks that and will not display the table since it considers it a system table. Impala did not check for owner=null and would display the table. This confused the user. I changed the Impala code to also check for owner= null. Don't think you will be able to test this though.

2) Hive server 2 allows column expansion for external tables and Impala does not.

3) Hive server 2 allows "Script object to new window as"  and Impala does not.

These two issues are related. Unlike all other H2 and Cloudera Impala's, the Describe Formatted command for MapR Impala does not return column information. ADS code was expecting that column information was available. Since the data was missing,  it would not display anything related to column information. This fix should take care of this by providing the expected column information in ADS.

Thanks in advance, Tom

Verified in AD v17 and v18. Customer issue is also resolved.