What are BlueConic data processors?
Data processors are used in certain BlueConic connections to transform or filter data being exchanged between BlueConic and other systems. Data processors ensure that BlueConic imports and exports the data correctly by cleaning up or transforming the data, to store data in normalized format, or to remove variations in addresses, for example. This helps you to ensure that data being exchanged is validated, corrected, and cleansed.
Watch the video: Data Processors Overview
BlueConic data processors
Here are some examples of available data processors that transform or filter data being imported to or exported from BlueConic:
|Email cleansing||Clean up email addresses to fix mistakes. For example, correcting firstname.lastname@example.org to email@example.com|
|Add a fixed value||Adds a field with a fixed value when importing data. For example, to set the data source.|
|Convert a value||Allows you to convert values to ones that are clearer for segmentation (e.g., “F” becomes “Female”).|
|Concatenate fields||Links together values from different fields and makes them available as a new field.|
|Add current date||Adds a field with the current date.|
|Address normalization||Normalize addresses to format state or country codes. For example, changing 179 Lincoln Street, Boston, Mass., USA to 179 Lincoln St., Boston, MA U.S.|
|Name normalization||For example, to change Bob Smith, Bobby Smith, and Robt. Smith to Robert Smith.|
Which BlueConic Connections use data processors?
The following BlueConic connections enable you to use data processors:
- Amazon Web Services (S3) Connection
- Azure Blob Storage Connection
- Facebook Leads Connection (for data imports)
- Google BigQuery Connection
- Kafka Connection (for data imports)
- Salesforce Marketing Cloud Connection (for data imports)
- SFTP Connection
- Snowflake Connection
How to use data processors in a connection
Important: To have one or more data processors added to your BlueConic environment, contact your Customer Success Manager.
- Once you have had a data processor added to your BlueConic environment, open the Import or Export goal settings of your connection. See the list of connections that support data processors.
- In the configuration step for processing, transforming, or filtering your data, select each processor you want to use for the data import or export. For example, in the SFTP Connection, you select data processors in step 3:
- For data processors that require configuration, click the configuration (cog wheel) icon and select the relevant data fields from your CSV file.
For example, if you select the Email cleansing processor, you would choose the email field.
- Some data processors affect the selection of which profiles are exported/imported. In these cases, you'll see a message in the segment selection step, or the Timeline event mappings step alerting you that a data processor might have impact on this aspect of the export.
- Complete the configuration steps, turn the connection on, save your changes, and schedule or run the connection.
For more information, or to install data processors for your connections, contact your BlueConic Customer Success Manager.
Data processors in the BlueConic plugin gallery
You can access and add available data processors via the BlueConic plugin gallery. Open the Settings > Plugins page and click the Add plugin button. This opens a lightbox window with several options for add a new data processor plugin: via the plugin gallery, by uploading a Zip file, or by registering an external URL.
Find related data processors
You can find data processors used for the current connection listed in the Related items widget on the right side of the BlueConic window. Learn more about navigating your Related items in BlueConic.