Skip to main content

Using MarkLogic Content Pump (mlcp)

mlcp Auto-scaling with Data Hub Service

Before 10.0-6, mlcp import jobs ran with a fixed number of threads until completion. After 10.0-6, mlcp reactive auto-scaling capability for import jobs is enabled when running against Data Hub Service (DHS) hosted on AWS/Azure. The concurrency of mlcp now adjusts periodically based on the available server threads as the dynamic e-nodes come and go in DHS. This feature improves mlcp performance by leveraging the scaling feature of DHS.