MarkLogic Data Hub 5.4 - Release Notes

Data Hub 5.4.4

Important: Upgrading to this release from earlier than 5.2.0 would trigger a reindexing of the STAGING and FINAL databases.

Bug fixes.

Note: To learn more about the details of this release, see GitHub Release Notes for Data Hub 5.4.4.

Data Hub 5.4.3

Important: Upgrading to this release from earlier than 5.2.0 would trigger a reindexing of the STAGING and FINAL databases.

Bug fixes.

Note: To learn more about the details of this release, see GitHub Release Notes for Data Hub 5.4.3.

Data Hub 5.4.2

Important: Upgrading to this release from earlier than 5.2.0 would trigger a reindexing of the STAGING and FINAL databases.

Bug fixes.

Note: To learn more about the details of this release, see GitHub Release Notes for Data Hub 5.4.2.

Data Hub 5.4.1

Important: Upgrading to this release from earlier than 5.2.0 would trigger a reindexing of the STAGING and FINAL databases.

Bug fixes.

Note: To learn more about the details of this release, see GitHub Release Notes for Data Hub 5.4.1.

Data Hub 5.4.0

Data Hub 5.4.0 includes the following new features and changes:

Important: Upgrading to this release from earlier than 5.2.0 would trigger a reindexing of the STAGING and FINAL databases. Learn more about how reindexing works and its impact on performance.
Hub Central - New GUI for DHS and On-Prem

Hub Central is an all-new graphical interface for use in Data Hub Service (DHS) and an on-premises or local environment. With Hub Central, you can do most of your development and testing work on a DHS instance or your own on-premises servers. You can also more easily explore your data using faceted filters and search tools. Learn more: About Hub Central, About Hub Central On-Premises, Create Project and Access Hub Central

New Hub Central Format for Artifacts

The configuration structure for flows and steps used in Hub Central (HC format) is different from the configuration structure used in QuickStart (QS format). Flows and steps in the QS format cannot run in Hub Central; likewise, flows and steps in the HC format cannot run in QuickStart.

You can convert your flows from QuickStart format to Hub Central format; however, backward conversion is not available. Learn more: Convert Your Artifacts from Quickstart to Hub Central

You can use either format with the Data Hub Gradle plugin. Learn more: Gradle Tasks

Important: If you switch to HC format, remember to update your custom modules to accommodate the new configuration structure of flows and steps.
New and Updated Security Roles
  • New roles are added to access Hub Central features.
  • Additional privileges are assigned to default roles, including privileges to perform actions on temporal documents and privileges to apply redaction rules defined in a custom module.
  • New Gradle tasks (hubDescribeUser, hubDescribeRole, and hubPrintInheritableRoles) provide the most up-to-date security information about users and roles.

Learn more: Users and Roles

Note: User accounts are not automatically generated for these roles. The MarkLogic Server admin must assign new or existing user accounts to the appropriate roles.
Updates to the Gradle Plugin
  • New Gradle tasks have been added and existing Gradle tasks have been updated to handle the new Hub Central format and to make it easier to manage your data hub in Data Hub Service (DHS). Learn more: Gradle Tasks
  • New composite properties hubDhs and hubSsl are now available to simplify your settings to access DHS through Gradle. Learn more: Data Hub Properties - Composite Properties for DHS
Step Interceptors

Step interceptors are custom processes that are executed in addition to the core processes of the step. Interceptors are preferred over custom hooks. Step interceptors are run within the same server transaction as the core processes, whereas custom hooks are run in transactions separate from the core processes.

Learn more about interceptors and custom hooks.

Source Query as Script

In a custom step, you can now set sourceQuery to a script that retrieves items of different data types to pass to your custom step module. If the sourceQuery is set to a collection or a cts:query, only the URIs of the resulting documents are passed to the step module.

Learn more about setting sourceQuery to a script.

Changes to Prerequisites

The prerequisites have changed. This version of MarkLogic Data Hub requires:

  • Gradle 6.4

Data Hub 5.3.0

Data Hub 5.3.0 was released only as an internal beta.

Release Notes for Earlier Versions