Help Center

Snowflake Connection

How to connection BlueConic customer data platform profiles to Snowflake via Amazon S3

What: The Snowflake connection allows you to enrich BlueConic profiles with data from Snowflake and vice versa, via an Amazon S3 server. This connection supports scheduled batch import and export.

About BlueConic: The BlueConic customer data platform harnesses the data required to power the recognition of an individual at each interaction, and then synchronizes their intent across the marketing ecosystem.

Why: By exchanging profile data between BlueConic and Snowflake, you can share first-party customer data from BlueConic profiles using data stored in Snowflake, and vice versa.

Creating a Snowflake connection

  1. Click Connections in the BlueConic navigation bar.
  2. Click Add Connection.
  3. A pop-up window appears. Enter "Snowflake" in the Search bar.
    How to create a Snowflake connection in BlueConic to synchronize customer data between the BlueConic CDP and Snowflake data stores
  4. Click Snowflake connection.
    The Snowflake connection page opens. You can expand or collapse the metadata fields (to mark it as a favorite, add labels, or write a description) by clicking the gray chevron icon How to edit metadata and get email notifications for connections running in BlueConic.
  5. In the metadata section you can choose whether to get email notifications when the connection runs or fails to run.
  6. Enter a name for your connection at the top of the page and save your settings.
    A new Snowflake connection page opens.

Configuring a Snowflake connection with BlueConic

To set up a connection between BlueConic and Snowflake, you need to add your Snowflake account credentials as well as your Amazon Web Services (S3) account information, in order to authenticate the connection. 

Snowflake database privileges required 

For all databases that will be accessed via the BlueConic Snowflake Connection, your account must have the following grants:

  • SELECT
  • INSERT
  • UPDATE
  • DELETE
  • CREATE STAGE
  • CREATE FILE FORMAT
  • CREATE OR REPLACE FILE FORMAT

Setting up a Snowflake connection in BlueConic

  1. Select Set up and run in the Setup section in the left panel.
  2. In the Snowflake authentication section, enter your Snowflake account with the corresponding region, username, and password.
    How to authenticate connections between Snowflake and BlueConic
    Note: To authenticate with Snowflake, enter your account name supplemented with the region. For example, “blueconic.eu-west-1” or “blueconic.dev.us-central1.gcp” would be accepted values.
  3. In the S3 setup and authentication section, enter the Amazon Web Services (S3) access key ID, secret access key, and S3 bucket.
    To authenticate a Snowflake Connection in BlueConic, you need to link you Snowflake account and also you Amazon S3 account to the connection
    Note: BlueConic saves files to the bucket root of the S3 server.
  4. Save your settings.

Once the authentication is complete, you'll create at least one import or export goal, turn the connection on, and either schedule or run the connection. Follow the steps outlined below.

Creating import goals

Click Add goal in the lower left panel and select Import profiles to open the page to configure your data import from Snowflake to BlueConic.

  1. Select a BlueConic domain group.
    Only profiles in the domain group you select will be added or updated.
  2. Select the location of the data in Snowflake.
    Here, you can tell BlueConic where to find the data to be imported by selecting your Snowflake database, schema, and table. You can select multiple nested tables to import data from. Use the circular link icon to link tables together through IDs that exist in both tables.
    snowflake_location_data2.jpg
  3. Optional: Correct your files before the import
    Add a data processor to transform, filter, or manipulate your data (e.g., email cleansing, name normalization).
  4. Link identifiers between Snowflake and BlueConic.
    To match customer data between the two systems, enter one or more customer identifiers. Use the dropdown menu in the BlueConic field to select either the BlueConic profile identifier or a profile property. 
    How to link customer identifiers between Snowflake and BlueConic
    Use the "Allow creation..." checkbox to allow BlueConic to create new profiles for data that does not match an existing BlueConic profile.
  5. Map Snowflake data to BlueConic profile properties.
    Match Snowflake fields on the left with BlueConic profile properties on the right. Use the dropdown at the right to select how imported content should be added to existing values:
    • Set
    • Set if empty (if the profile property is empty)
    • Set or clear (if the Snowflake field is empty) 
    • Add the data field to the list of existing values
    • Sum a number with the existing values (if the data field is a number)
    How to map data fields while importing customer data from Snowflake to the BlueConic CDP
    Use the Add mapping button to create additional mapping rows. You can add multiple mapping rows at once with the "Add remaining fields" option. BlueConic detects the remaining Snowflake fields and matches them with BlueConic profile properties. You can set the merge strategy for imported field (set, set if empty, set or clear, add, sum) and also provide a custom prefix to the names of BlueConic profile properties (optional). 
  6. Optional: Import events to the BlueConic Timeline
    Click Import data into BlueConic events, select a BlueConic timeline event type, and map the correct Snowflake fields into the corresponding BlueConic Timeline event properties.
    snowflake_timeline_event.jpg
  7. Run the connection.
    Review Scheduling and running connections for details.

Creating export goals

Click Add goal in the lower left panel and select Export profiles to open the page to configure your data export from BlueConic to Snowflake.

  1. Select a BlueConic segment for the export.
    Only profiles in this segment that have matching identifiers in Snowflake will be exported.
    How to select a customer segment to export to Snowflake from BlueConic
  2. Select a location in Snowflake for the export.
    Select the Snowflake database, schema, and table to export profile data to (or create new ones here). 
    How to select a Snowflake database, schema, and table for exporting customer data to Snowflake from BlueConic
    Note: If you set the export goal to use a predefined Snowflake table, BlueConic will try to merge the new values into the existing table without rewriting, overwriting fields defined in the mapping, or adding new rows.
  3. Optional: Correct your files before the export
    Add a data processor to transform, filter, or manipulate your data (e.g., email cleansing, name normalization).
  4. Link identifiers between BlueConic and Snowflake.
    Here, you match identifiers between BlueConic profiles and Snowflake fields. You can optionally choose to let BlueConic create new records in Snowflake if no existing match is found.
    How to link unique customer identifiers between the Snowflake database, schema and table with BlueConic
  5. Map BlueConic data to Snowflake.
    Match the BlueConic data fields you're exporting to Snowflake fields. In each mapping row (created via the Add mapping button), select the type of information you want to export by clicking the BlueConic icon and choosing one of these options from the dropdown:
    • Profile property: The value of a specific profile property.
    • BlueConic profile identifier: The unique identifier for a profile.
    • Associated segments: All segments, or a selection of one or more specific segments that the profile is associated with.
    • Associated lifecycles: All lifecycles this profile is associated with. Learn more about Lifecycles here.
    • All viewed interactions (all time): The interactions that the profile has seen.
    • Permission level: The permission level set in the profile.
    • Text value: Any static text
    • Processor value (optional): If you have selected one or more data processors in step 3, map the processor value(s) here. For example, if you are using a data processor that outputs several values, add them here as fields to be mapped to Snowflake.
    snowflake_map_data_dropdown.jpg
  6. Optional: Export BlueConic Timeline events to a Snowflake table
    To create a new set of mappings, click the Export events to Snowflake button. Here, you select a table from Snowflake, select your BlueConic Timeline event type, and then map your Timeline events on the left with Snowflake fields on the right. Additional mappings let you export BlueConic profile property data with your event data. (Note: If you have installed data processors in your tenant, the processor(s) you select in step 3 can filter or transform your event data.)
    snowflake_timeline_events3.jpgTip: To help manage the amount of event data exported, choose a time period for the events you want to export through the Timeline period section at the bottom of this step.
    Timeline_exports_BigQuery_Time_period.png
  7. Run the connection.
    You'll notice the arrows running between BlueConic and Snowflake in the upper left corner of the page. Green arrows in each direction indicate active import and export goals, ready to be run.

    How to run a Snowflake Connection in the BlueConic customer data platform

    Review the article Scheduling and running connections for more details.

Data exchange

Once the connection has been run, the data exchange section in the Setup page shows the number of unique BlueConic profiles imported from and exported to Snowflake via this connection.

Snowflake-Connection-BlueConic-Profile-Data-Exchange.png

Scheduling the Snowflake connection

To run the connection on a schedule, follow these steps:

  1. Click Set up and run in the left-hand panel.
  2. Click the settings icon How to run a connection between Snowflake and BlueConic in the Run history section of the Set up and run page.
  3. Schedule the connection to run by choosing options in the Schedule window.
  4. Click OK.
  5. Switch the connection On and Save your settings.
  6. To run the connection immediately, click Run now.
    After the connection has run, scroll down to the Run history section. This table shows all past and scheduled runs for the connection. In the details column, it also lists the last five created or updated profiles and links to the profile identifier so you are able to see exactly how and whether profiles were created or updated correctly.
    Note: BlueConic does not clean up or delete files from the S3 bucket after the connection runs.
    BlueConic-run-history-see-updated-profiles.png

Learn more about scheduling and running BlueConic connections.

Privacy management

Connections can be added to Objectives, allowing for privacy management of the information that is being picked up. A connection will only process the profiles of visitors who have consented to at least one of the objectives that the connection is linked to.

Was this article helpful?
0 out of 0 found this helpful