Import Your Smart Mastering Core Projects
If you used the Smart Mastering Core to define matching and merging rules for your data, you can import those rules as match and merge options into a mastering step in a Data Hub flow.
Procedure
- Upgrade Smart Mastering Core to the latest 1.3.x version.
- In your Smart Mastering Core build.gradle file, change the Smart Mastering Core version to
1.3.0
. - Run the Gradle task
mlDeploy
../gradlew mlDeploy -i gradlew.bat mlDeploy -i
See Smart Mastering Core's upgrade.md for potential compatibility issues.
- In your Smart Mastering Core build.gradle file, change the Smart Mastering Core version to
- Get your Smart Mastering Core options in JSON format.
Use the following REST endpoints to retrieve your Smart Mastering Core options:
- Match options:
/v1/resources/sm-match-options?rs:name=your-options-name
- Merge options:
/v1/resources/sm-merge-options?rs:name=your-options-name
- Match options:
- In Data Hub, create a project.
- Create a flow.
- Create a mastering step.
- Manually edit your flow configuration file to add your Smart Mastering options.
- In your flow configuration file (your-project-root/flows/your-flow-name.flow.json), go to the
steps
node, then the mastering step, then theoptions
property of that step. - Under the
options
property, set the values of matchOptions and mergeOptions to the appropriate JSON that you retrieved from your Smart Mastering Core project.
Example:
{ "name" : "MyFlow", ... "steps" : { ... "3" : { "name" : "MyMasteringStep", "description" : "", "options" : { ... "mergeOptions" : { *** Replace this value with the appropriate JSON from your Smart Mastering Core project. *** }, "matchOptions" : { *** Replace this value with the appropriate JSON from your Smart Mastering Core project. *** }, "sourceCollection" : "MyMappingStep", "targetDatabase" : "data-hub-FINAL" }, ... "stepDefinitionName" : "default-mastering", "stepDefinitionType" : "MASTERING" }, ... } }
- In your flow configuration file (your-project-root/flows/your-flow-name.flow.json), go to the
- Deploy your changes.
./gradlew mlDeploy -i gradlew.bat mlDeploy -i