Behavioral Changes
Behavioral changes denote a marked change in behavior from the previously released version to this version of software. In HDP 2.6.0, behavioral changes affect the following Hadoop components.
Table 1.13. Behavioral Changes
| Hortonworks Bug ID | Apache Component | Apache JIRA | Summary | Details |
|---|---|---|---|---|
| BUG-66121 | Hive | HIVE-14251 | Union All of different types resolves to incorrect data |
Scenario: UNION result handling Previous Behavior: queries in which union operator was used may have created an invalid output type.for example, the column type is ambigous in the following query: select cast(1 as int) union select cast(1 as string) Selecting the inappropriate type may cause the value to be changed
to New Behavior: The types are checked prior to execution; and the ambigous cases are rejected; FAILED: SemanticException Schema of both sides of union should match: Column _c0 is of type int on first table and type string on second table. Cannot tell the position of null AST. (state=42000,code=40000) The query should be clarified with explicit casts. |
| BUG-68588 | Spark | N/A | Livy Interpreter should run in Scoped mode |
Component Affected: Livy Interpreter in Zeppelin Scenario: The Livy interpreter has been refactored in HDP 2.6.0 to change the mode from shared to per user scoped. Shared mode does not work for HDP 2.6.0. Previous Behavior: Use shared mode in HDP 2.5. New Behavior: Use per user scoped mode in HDP 2.6. Workaround: Change the mode to per user scoped mode when upgrading from HDP 2.5.x to HDP 2.6.0. |
| BUG-69438 | Zeppelin | AMBARI-18975 | Remove Zeppelin View from Ambar |
Component Affected: Zeppelin, Ambari Views Scenario: Zeppelin view on Ambari is deprecated. Previous Behavior: Zeppelin view was available in the list of views on Ambari UI. New Behavior: There is no view for Zeppelin. Users can access Zeppelin via Quick links or by directly going to the configured Zeppelin hostname and port. |
| BUG-72046 | Oozie Spark action | N/A | Yarn-client mode for the Spark action is deprecated |
Component Affected: Spark action in Oozie Scenario: The yarn-client mode of the Spark action has been deprecated in HDP 2.6.0 and will be removed in HDP 3.0.0. New Behavior: No change in current behavior for HDP 2.6.0. For HDP 3.0.0, yarn-client mode for the Spark action in Oozie will no longer be available. |
| BUG-76651 | Spark | N/A | Behavior change of Livy interpreter |
Component Affected: Spark Scenario: Livy Interpreter in Zeppelin Previous Behavior: In HDP 2.5. 0, Livy would parse the code line by line, streaming the output to the frontend user as it is received. New Behavior: In HDP 2.6.0, Livy recieves the code in blocks. This means the output is only displayed when the entire block is recieved. |
| BUG-91290 | Hive, Ranger | N/A | Additional ranger hive policies required for INSERT OVERWRITE |
Scenario:Additional ranger hive policies required for INSERT OVERWRITE Previous behavior: Hive INSERT OVERWRITE queries succeed as usual. New behavior: Hive INSERT OVERWRITE queries are unexpectedly failing after upgrading to HDP-2.6.x with the error: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user jdoe does not have WRITE privilege on /tmp/*(state=42000,code=40000) As of HDP-2.6.0, Hive INSERT OVERWRITE queries require a Ranger URI policy to allow write operations, even if the user has write privilege granted through HDFS policy. Workaround/Expected Customer Action:
|
| RMP-8089 | Zeppelin | N/A | Ambari service definition to change to work with Azure LLAP Clusters |
Component Affected: Zeppelin Scenario: In the previous release of Zeppelin in HDP 2.5, Spark was a required service to install Zeppelin. Previous Behavior: On Ambari install wizard Spark was selected during the installation process. New Behavior: There is no Spark dependency while running Ambari install wizard. Spark/Spark 2 are optional and are required only if the user wish to run Spark Interpreter in Zeppelin. |