Delta Sharing for Databricks lets you activate and analyze customer data stored in your Databricks environment. With Delta Sharing enabled, Databricks acts as a sub-processor and provides governed, zero-copy data exchange between your Databricks environment and a Databricks instance used by BlueConic. BlueConic then ingests that data into your tenant.
Availability
Delta Sharing is available to tenants that use the new Databricks Connection with Delta Sharing support. Contact BlueConic Support to request access.
Already have access to the Databricks Connection with Delta Sharing support? Read the dedicated knowledge base article to set up the connection.
Why use Delta Sharing
Zero-copy data access: BlueConic reads data from your Databricks environment through a zero-copy architecture, so no duplication occurs between your Databricks instance and the Databricks instance used by BlueConic.
Credential-free setup: Delta Sharing uses the Databricks Delta Sharing protocol, so you do not need to share or rotate credentials.
Regional flexibility: Delta Sharing is available in any Databricks-supported region.
Cloud platform flexibility: Delta Sharing supports Amazon Web Services (AWS), Microsoft Azure, and Google Cloud.
Support for Databricks views: BlueConic can read from views.
Efficient change-based data transfer: BlueConic imports only changes, which reduces data volume and cost.
Cost-optimized integration: The integration is designed to support cost-efficient data import and export with Databricks.
Cross-platform interoperability: Data shared through Delta Sharing can also be used by other supported vendors.
Security and privacy
BlueConic has fully vetted Databricks for security and privacy review. Databricks complies with Service Organization Control 2 (SOC 2) Type II, the General Data Protection Regulation (GDPR), the Health Insurance Portability and Accountability Act (HIPAA), and other industry standards. All data exchanged through Delta Sharing is encrypted at rest and in transit. Your Databricks Unity Catalog roles and policies continue to govern access. See the Databricks Trust Center for more details.
For FAQs, refer to this section.