AWS DynamoDB CDC

Amazon DynamoDB is a fully managed NoSQL database service that provides fast and predictable performance with seamless scalability. DynamoDB lets you offload the administrative burdens of operating and scaling a distributed database so that you don’t have to worry about hardware provisioning, setup and configuration, replication, software patching, or cluster scaling. DynamoDB also offers encryption at rest, which eliminates the operational burden and complexity involved in protecting sensitive data.

With DynamoDB, you can create database tables that can store and retrieve any amount of data and serve any level of request traffic. You can scale up or scale down your tables' throughput capacity without downtime or performance degradation. You can use the AWS Management Console to monitor resource utilization and performance metrics.

If you are interested in a direct Decodable Connector for DynamoDB CDC, please contact support@decodable.co or join our Slack community and let us know!

Overview

Connector name

dynamodb-cdc

Type

source

Delivery guarantee

exactly once

Getting Started

Sending a data stream from DynamoDB CDC to Decodable is accomplished in two stages, first by populating an AWS Kinesis stream with DynamoDB CDC data, and then by adding and configuring a Kinesis source connector in Decodable.

Create Kinesis Data Source

To capture a data change stream from DynamoDB, a Debezium server is created with an DynamoDB CDC connector, which populates an AWS Kinesis stream.

  1. Create a Kinesis stream

  2. Create a DynamoDB table

  3. Go to the Exports and streams and enable Amazon Kinesis data stream details.

  4. Provide the Kinesis stream you created.

For more detailed information, please refer to the DynamoDB CDC example in the Decodable GitHub repository.

Configure A Kinesis Source

Sign in to Decodable Web and follow the configuration steps provided for the AWS Kinesis to create a source connector. For examples of using the command line tools or scripting, see the How To guides.