Release Notes
Also available as:
PDF

​Behavioral Changes

Behavioral changes denote a marked change in behavior from the previously released version to this version of software. In HDP 2.6.1, behavioral changes affect the following Hadoop components.

​

Table 1.4. Behavioral Changes

Hortonworks Bug IDApache ComponentApache JIRASummaryDetails
BUG-66121HiveHIVE-14251 Union All of different types resolves to incorrect data

Scenario: UNION result handling

Previous Behavior: queries in which union operator was used may have created an invalid output type.for example, the column type is ambigous in the following query:

select cast(1 as int) union select cast(1 as string)

Selecting the inappropriate type may cause the value to be changed to NULL.

New Behavior: The types are checked prior to execution; and the ambigous cases are rejected;

FAILED: SemanticException Schema of both sides of union should match: Column _c0 is of type int on first table and type string on second table. Cannot tell the position of null AST. (state=42000,code=40000)

The query should be clarified with explicit casts.

BUG-76637RangerRANGER-1436Turn Ranger Deny Policy & Except Conditions block to Off by default

Component Affected: Ranger resource based policies

Previous Behavior: Previously, you could not enable deny/exception conditions through a configuration change. This was only possible through a Ranger REST API call.

New Behavior: You can now turn this feature on by setting the ranger.servicedef.enableDenyAndExceptionsInPolicies config parameter to a value of true. The default value for this is false (disabled).

BUG-81924Falcon, HveN/AUse the hive.metastore.transactional.event.listeners configuration parameter instead of hive.metastore.event.listeners

Component Affected: HiveDR replication on Falcon

Scenario: Although both parameters perform similar functions, hive.metastore.transactional.event.listeners provides better handling of failures for Falcon-Hive integration.

Previous Behavior: If HiveDR was enabled on a cluster, then the setting hive.metastore.event.listeners had to be set with the value org.apache.hive.hcatalog.listener.DbNotificationListener

New Behavior: If HiveDR is enabled, DbNotificationListener should belong to hive.metastore.transactional.event.listeners.

Do the following in hive-site.xml:

  1. Set hive.metastore.transactional.event.listeners="org.apache.hive.hcatalog.listener.DbNotificationListener"

  2. If set, remove hive.metastore.event.listeners="org.apache.hive.hcatalog.listener.DbNotificationListener"

BUG-91290Hive, RangerN/AAdditional ranger hive policies required for INSERT OVERWRITE

Scenario:Additional ranger hive policies required for INSERT OVERWRITE

Previous behavior: Hive INSERT OVERWRITE queries succeed as usual.

New behavior: Hive INSERT OVERWRITE queries are unexpectedly failing after upgrading to HDP-2.6.x with the error:

Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user jdoe does not have WRITE privilege on /tmp/*(state=42000,code=40000)

As of HDP-2.6.0, Hive INSERT OVERWRITE queries require a Ranger URI policy to allow write operations, even if the user has write privilege granted through HDFS policy.

Workaround/Expected Customer Action:

  1. Create a new policy under the Hive repository.

  2. In the dropdown where you see Database, select URI.

  3. Update the path (Example: /tmp/*)

  4. Add the users and group and save.

  5. Retry the insert query.