BlueConic firehose connections send customer profile data from BlueConic to your cloud data stores in real time. These connections enable you to enrich profiles using machine learning, send data to analytics tools for customer journey analysis, and stream data to data lakes/warehouses for modeling to gain customer insights.
Available firehose connections:
Note: Firehose connections use BlueConic's network to send data. Fair use policies manage usage. To evaluate or stop using the connection, contact your Customer Account Manager. Continued use of this connection means you agree to any additional charges or fees that may apply.
Before you begin
Collect credentials and confirm you have an account with either Amazon Kinesis, Google Cloud Pub/Sub, or Microsoft Azure Event Hubs.
Determine the specific data you intend to stream (e.g., profile properties, events, etc.) and where it will be used.
Types of data to stream
Unified profiles or only selected profile properties.
Dialogue views, clicks, and conversions.
Events from the BlueConic dialogues 'When' tab.
UTM parameters of landing pages.
Record of all dialogues a customer saw before completing a specific conversion goal.
Page view events.
Note: Firehose connections do not send Timeline events or associated lifecycle information.
Firehose connection scenarios
These examples illustrate the structure of data sent through firehose connections for different scenarios.
Profile update
Shows updated user profiles sent through a firehose. If the profile changes, the values for the profile properties "Last Visited Date" and "Email Address" are sent to the firehose.
Sample message: The profile property IDs sent are 'lastvisitdate' and 'email' for the changed visitor profile. The Export segments box is checked, so the visitor's segments are also sent.
{ "eventDateTime":"1538119536237", "eventType":"PROFILE_CHANGED", "profile":{ "id":"e6fe897a-0e76-934c-8dd0-844fc380af72", "properties":{ "lastvisitdate":[ "1538119531026" ], "email":[ "[email protected]" ], }, "segments":[ { "id":"0e3e6219-108c-47b4-8342-3bc2fb32f451", "name":"2 - 4 visits" }, { "id":"2caadd28-a4d1-4177-b4c7-7a87b55d58ff", "name":"Visitors with an email address" } } }Note: Profile changes are sent to the firehose two minutes after the last change to the BlueConic profile. Learn about real-time data for firehose streaming.
Dialogue click
Shows firehose messages sent when dialogue clicks occur. The message includes full profile properties, the name of the dialogue clicked, and dialogue variants.
Sample message: The full list of profile properties has been removed for brevity.
{ "eventDateTime":"1538119536237", "eventType":"DIALOGUE_CLICK_EVENT", "profile":{ "id":"e6fe897a-0e76-934c-8dd0-844fc380af72" }, "dialogue":{ "dialogueId":"09c6816f-e366-5c5b-b73f-2f741e0196ed", "dialogueName":"Subscription Lightbox", "variantId":"e3ae6e06-73be-38bc-bb4f-9e977fccb7a8", "variantName":"Variant A" } }
Dialogue conversion
Shows customer conversion events.
Sample message: Shows the dialogue that won the conversion (Content Meter ONE) and losing variants (in "otherCandidates"). The losing variants' 'last viewed' or 'last clicked' moments are older than the winning dialogues.
{ "eventDateTime":"1538119536237", "eventType":"DIALOGUE_CONVERSION_EVENT", "profile":{ "id":"e6fe897a-0e76-934c-8dd0-844fc380af72" }, "dialogue":{ "dialogueId":"09c6816f-e366-6c6d-b73f-2f741e0196ed", "dialogueName":"Content Meter ONE", "variantId":"e3ae6e06-73be-38bc-bb4f-9e977fccb7a8", "variantName":"Variant A" }, "otherCandidates":[ { "dialogueId":"781c7642-ca2c-60b3-8c8c-ee7df348ca37", "dialogueName":"Content Meter TWO", "variantId":"09810450-dfb7-59d8-932f-9ee5220f3abd", "variantName":"Variant A" }, { "dialogueId":"09c6816f-e366-6c6d-b73f-2f741e0196ed", "dialogueName":"Content Meter ONE", "variantId":"856ae2bc-018c-445c-de23-cc91aa6edf34", "variantName":"Variant B" } ] }
Custom event
Shows custom events that BlueConic allows you to trigger to capture user behavior or changes. For example, a custom event can be triggered if a visitor puts an item in a shopping cart or signs up for a newsletter.
Sample message: Shows the custom event message, which measures the customer's exit intent and includes dialogue variants shown after the event.
{ "eventDateTime":"1538119536237", "eventType":"CUSTOM_EVENT", "customEventId":"exitintent", "profile":{ "id":"e6fe897a-0e76-934c-8dd0-844fc380af72" }, "dialogues":[ { "dialogueId":"781c7642-ca2c-60b3-8c8c-ee7df348ca37", "dialogueName":"Content Meter TWO", "variantId":"09810450-dfb7-59d8-932f-9ee5220f3abd", "variantName":"Variant C" }, { "dialogueId":"927a8162-cd91-00b1-93ab-8361caed92d6", "dialogueName":"Content Meter THREE", "variantId":"856ae2bc-018c-445c-de23-cc91aa6edf34", "variantName":"Variant A" } ] }Next steps
Determine the firehose connection you want to configure.
FAQs
Why should I use a firehose connection instead of batch uploads?
Firehose connections provide real-time data transfer, while batch uploads run on a schedule. Firehose connections send a message when a visitor's profile is updated or an event is triggered.
What does "real-time" mean in the context of firehose connections?
In this context, real-time has the following specific timing details:
Changes to profile properties are sent to the stream after being "in rest" for 2 minutes, meaning that no changes occurred in the past 2 minutes.
Events are sent every 10 seconds.
Where can I monitor firehose traffic data in BlueConic?
In the BlueConic settings > General section, you can monitor your traffic metrics by clicking Firehose traffic breakdown. A pop-up window opens with a list of all streaming goals and the firehose traffic they generated. See the article on General Settings for more details.