Azure Cosmos DB CDC & Target Connector: Unlock Bi-Directional Data Integration With Gluesync

The Azure Cosmos DB connector for Gluesync is now generally available, offering both Change Data Capture (CDC) and Target functionalities. This versatile update allows businesses to synchronize their data with Azure Cosmos DB and capture changes from it, providing a comprehensive solution for data integration and real-time analytics.

azure Cosmos DB: a multi-model database for cloud-native applications

Azure Cosmos DB is a fully managed NoSQL database service provided by Microsoft Azure. It offers multi-model database capabilities, supporting document, key-value, wide-column, and graph databases. With the Azure Cosmos DB connector, you can both send data to and receive data from Azure Cosmos DB, centralizing your information and making it available for in-depth analysis.

Integration with Gluesync: Flexibility and Control in both directions

Gluesync 2.0’s future-proof architecture enables efficient and flexible data synchronization for both SQL and NoSQL models. The Azure Cosmos DB connector supports bi-directional data flow:

1. as a target: you can replicate data from various sources directly into your Azure Cosmos DB instance.
2. as a source (CDC): you can capture changes in your Azure Cosmos DB and replicate them to other supported targets.

Key Features of the Azure Cosmos DB connector

The Azure Cosmos DB connector for Gluesync includes several key features:

• bi-directional data flow (CDC and Target capabilities);
• support for insert, update, and delete operations;
• secure communication using Azure Key authentication;
• configurable container targeting.

Prerequisites and configuration

To use the Azure Cosmos DB connector, you’ll need:

•  a valid Azure Cosmos DB Service key;
• an instance of Azure Cosmos DB.

configuration details

Setting up the Azure Cosmos DB connector is straightforward and can be done through the web interface or REST API. Key configuration details include:

• hostname/IP address: the hostname of your Azure DB service;
• port: optional, defaults to 443;
• database name: the name of your source Namespace;
• Azure Key: the key of your Azure Cosmos DB service;
• container: the name of the target container;
• lease (for CDC): the name of the lease container for the Change Feed Processor.

Change Data Capture (CDC) specifics

Gluesync’s Azure Cosmos DB CDC connector leverages the Change Feed Processor for capturing delta changes from your Cosmos DB instance. To know more about the Change Feed Processor and how does it work you can check out the Microsoft’s documentation page available at this link.

For CDC functionality:

• a lease container is required for the Change Feed processor, which can be created manually or dynamically;
• the lease container coordinates processing across multiple workers and can be stored in the same or a separate account;
• currently, only “soft” (logical) delete operations are supported.

Benefits of using Azure Cosmos DB connector

The Azure Cosmos DB connector for Gluesync offers a unique blend of features that set it apart in the world of data management and analytics. At its core is the bi-directional data flow capability, allowing both data ingestion and change data capture – a versatility that’s rare among connectors. This adaptability is complemented by Azure Cosmos DB’s global distribution feature, ensuring low-latency data access worldwide.

The connector’s multi-model support is another standout feature, accommodating diverse data types and structures to suit a wide range of applications. This flexibility is matched by impressive scalability, with Azure Cosmos DB’s architecture allowing for seamless expansion in both storage and throughput without compromising performance.

Rounding out its capabilities, the connector offers multiple consistency levels, allowing businesses to fine-tune their balance between strong consistency and high availability. This combination of features makes the Azure Cosmos DB connector a powerful tool for businesses looking to build robust, globally distributed data architectures that can evolve with their needs.

In conclusion, the Azure Cosmos DB connector for Gluesync offers a powerful, bi-directional data integration solution. It enables businesses to centralize their data management, capture real-time changes, and leverage Azure Cosmos DB’s global distribution and multi-model capabilities. This versatility makes it an excellent choice for organizations looking to build robust, scalable, and globally distributed data architectures.

For more info about how it works you can have a look at our product documentation here at this link.