In select BlueConic connections, you can use the Duplicate check data processor to identify and skip the import of a data record if it was already imported within the same run.
Adding this data processor to your tenant
To use this processor, you first need to add it to your tenant through the Plugins page (BlueConic Settings > Plugins). Click the Add plugin button at the top of this page and look for "Duplicate check data processor" in the gallery. Then, click the Add plugin button underneath its description to install it.
Adding this data processor to a connection
The Duplicate check data processor is available in all BlueConic connections that use data processors. You can review the complete list here.
Each of these connections has a specific step on its import and/or export goal page to add data processors (e.g., "Correct your files before the import," "Modify your data before the export"). In that step, use the search box to add "Duplicate check"; once added, it appears in a numbered list of data processors activated for that connection.
For more information, review the full article Using data processors with BlueConic connections.
Configuring this data processor
The Duplicate check data processor requires some configuration to ensure that BlueConic imports or exports the data as specified. To make these configurations, click the cogwheel icon next to "Duplicate check" in the numbered list of data processors. This opens a window with the following settings:
- Identifier field: Select the field that contains the unique identifier of the data records. This field will be used to check for duplicates upon import.
Click OK to save your settings and apply the data processor to your connection.
Sample scenario for using this data processor
The Duplicate check data processor is a crucial part of use cases that involve linking and bundling event files, such as consolidating events within the same profile or bundling order data.