Linking across datasets

To match two datasets against each other

In many cases like reference data mastering, enrichment, etc, two individual datasets are free of duplicates but they need to be matched against each other. The link phase is used for such scenarios.

./ --phase link --conf config.json

Sample configuration file configLink.json is defined at examples/febrl. In this option, each record from the first source is matched with all the records from the remaining sources.

The sample output is given in the image below. The linked records are given the same z_cluster id. The last column (z_source) in the output tells the source dataset of that record.

Last updated