Claude Code Skills·Claude Skills·The open SKILL.md registry for Claude
ClaudSkills / Engineering / devops

Cdc Streaming Pipeline

Category: Engineering  ·  Sub-category: devops  ·  Last updated:
Build a real-time change-data-capture pipeline from a transactional database (Aurora DSQL, Aurora Postgres, RDS) to Redshift Serverless, S3, or any other sink, via Kinesis Data Streams (or MSK). Covers producer setup, consumer Lambda correctness, the append-only event log + reconstruction pattern, schema-drift handling with SUPER + JSON_PARSE, and the operational gotchas (Redshift Data API parameter caps, async statement polling, poison-record handling, retry-and-bisect). Use when the user asks for "CDC to Redshift", "stream change data capture", "Aurora CDC", "DSQL CDC", "Postgres replication to S3", or "build a Lambda consumer for Kinesis CDC". Aurora DSQL public-preview specifics are flagged; the rest is source-agnostic.

About this skill (catalog notes)

Cdc Streaming Pipeline includes explicit scope boundaries (an explicit 'when not to use' or 'out of scope' section); pricing or quota commentary; 15 code blocks for direct copy-paste. At roughly 3,228 words the SKILL.md is on the longer end of the catalog distribution.

Source
github.com/jaingxyz/dsql-redshift-cdc-pipeline
License
AGPL-3.0
Original author
jaingxyz
Indexed lastmod
Catalog position
Engineering · devops
Indexed related skills
10

How Cdc Streaming Pipeline fits the catalog

Cdc Streaming Pipeline sits in the Engineering category under the devops sub-topic in the ClaudSkills catalog. There are 10 related skills indexed alongside it; comparing a few before installing usually reveals which fits your workflow best.

These notes are auto-generated from features detected in the SKILL.md file and from this catalog's structure — they aren't part of the source repository.

From the source SKILL.md

This skill captures the lived patterns for building a real-time CDC pipeline: a transactional source publishes change events to Kinesis, a Lambda consumer applies them to a sink (Redshift Serverless event log, or S3 / Iceberg via Firehose). It is source-agnostic: the producer-side notes are split into "any CDC source" and "Aurora DSQL preview" callouts.

What this skill does

Cdc Streaming Pipeline is a community-contributed Claude Code skill in the devops sub-category. It ships as a SKILL.md file that Claude Code auto-discovers under ~/.claude/skills/cdc-streaming-pipeline/ and loads when your prompt matches the skill's trigger.

When to invoke it: Use when the user asks for "CDC to Redshift", "stream change data capture", "Aurora CDC", "DSQL CDC", "Postgres replication to S3", or "build a Lambda consumer for Kinesis CDC". Aurora DSQL public-preview specifics are flagged; the rest is source-agnostic.

Who uses this skill

The Cdc Streaming Pipeline Claude Code skill is built for software engineers, backend developers, full-stack teams, and technical leads building and maintaining production systems. It's part of ClaudSkills (also referred to as Claude Skills or Claude Code Skills) — the open community-curated registry of 96,000+ SKILL.md files for Anthropic's Claude Code agent and the wider Claude ecosystem (Claude API, Claude Agent SDK).

How to install

Free

Manual install (2 steps)

mkdir -p ~/.claude/skills/cdc-streaming-pipeline
curl -L https://claudskills.com/skills/cdc-streaming-pipeline/SKILL.md \
  -o ~/.claude/skills/cdc-streaming-pipeline/SKILL.md

Or just download SKILL.md directly and drop it into ~/.claude/skills/cdc-streaming-pipeline/. Claude Code auto-discovers it on next session.

Skills live at ~/.claude/skills/cdc-streaming-pipeline/SKILL.md on macOS/Linux, or %USERPROFILE%\.claude\skills\cdc-streaming-pipeline\SKILL.md on Windows. See the full install guide for step-by-step instructions.

Telegram

📱 Install from your phone or desktop Telegram

Open @claudskills_bot on Telegram, tap Open Desktop App, and the desktop app installs this skill for you. Or share the bot link with a colleague — they get the same one-tap install. Learn more →

Pro

One-click install via the desktop app

The ClaudSkills desktop app installs any skill directly into ~/.claude/skills/ with one click — no terminal required. Pro starts at $9/mo or $149 lifetime.

Pro

For the full experience including quality scoring and one-click install features for each skill — upgrade to Pro.

Frequently asked questions

How do I install the Cdc Streaming Pipeline Claude Code skill?
Install via the ClaudSkills desktop app (one click) or copy SKILL.md from the source repository to ~/.claude/skills/cdc-streaming-pipeline/SKILL.md and restart Claude Code. Both flows are detailed at claudskills.com/install/.
What does the Cdc Streaming Pipeline skill do?
Build a real-time change-data-capture pipeline from a transactional database (Aurora DSQL, Aurora Postgres, RDS) to Redshift Serverless, S3, or any other sink, via Kinesis Data Streams (or MSK). Covers producer setup, consumer Lambda correctness, the append-only event log + reconstruction pattern, schema-drift handling with SUPER + JSON_PARSE, and the operational gotchas (Redshift Data API parameter caps, async statement polling, poison-record handling, retry-and-bisect). Use when the user asks for "CDC to Redshift", "stream change data capture", "Aurora CDC", "DSQL CDC", "Postgres replication to S3", or "build a Lambda consumer for Kinesis CDC". Aurora DSQL public-preview specifics are flagged; the rest is source-agnostic.
Is this skill free to install?
Yes. ClaudSkills is an open registry — every skill keeps its source repository's license, and manual install via copy is free. ClaudSkills Pro ($9/mo, $79/yr, or $149 one-time) adds one-click install via the desktop app and a multi-signal Quality Score.
When should I use the Cdc Streaming Pipeline skill?
Use Cdc Streaming Pipeline when your Claude Code task falls under the Engineering category — specifically in the devops area. Claude Code auto-discovers installed skills and invokes the right one based on the task description, so you can also ask Claude directly (e.g. "use Cdc Streaming Pipeline" or describe the task and let Claude pick). Browse related skills at /category/engineering/.
What is a Claude Code skill and how does the Cdc Streaming Pipeline skill fit in?
A Claude Code skill is a SKILL.md file that lives under ~/.claude/skills/<name>/ and tells the Claude Code CLI agent how to perform a specific task (instructions, prompts, allowed tools). Skills are auto-discovered at session start. Cdc Streaming Pipeline is one of 67,000+ skills indexed in the open ClaudSkills catalog, classified under the Engineering category. Learn more at /learn/what-is-a-claude-skill/.

Attribution & license

Cite this skill

If you reference this skill in a blog post, paper, or documentation, you can cite it as:

APA
jaingxyz. (2026). Cdc Streaming Pipeline [Claude Code skill]. ClaudSkills. https://claudskills.com/skills/cdc-streaming-pipeline/
BibTeX
@misc{cdc-streaming-pipeline-2026,
  author    = {jaingxyz},
  title     = {Cdc Streaming Pipeline [Claude Code skill]},
  year      = {2026},
  publisher = {ClaudSkills},
  url       = {https://claudskills.com/skills/cdc-streaming-pipeline/}
}

Embed this skill

Promote, attribute, or link this skill from your own README, blog post, or documentation. All three snippets are free to use — no sign-up, no API key. More distribution surfaces →

Badge
[![ClaudSkills](https://claudskills.com/badge/cdc-streaming-pipeline.svg)](https://claudskills.com/skills/cdc-streaming-pipeline/?utm_source=badge&utm_medium=readme&utm_campaign=skill_badge)
<script>
<script src="https://claudskills.com/embed/cdc-streaming-pipeline.js" async></script>
<iframe>
<iframe src="https://claudskills.com/embed/cdc-streaming-pipeline.html" width="100%" height="160" frameborder="0" loading="lazy" title="ClaudSkills: Cdc Streaming Pipeline"></iframe>

Free. No spam. Unsubscribe in one click.

More Engineering skills

Browse all Engineering skills in the ClaudSkills registry, or explore these other picks from the same category:

Browse all Engineering skills → Top 100 skills
Part of ClaudSkills — the open registry for Claude Skills & Claude Code Skills.  ·  What's New  ·  Install guide  ·  About  ·  llms.txt

Part of Acreator Store — Adam Lankamer's AI tools: PerfectStudio · Ucaption · UTagger · AutoXPoster · TestYourSkills · AutomationFlows · Au Naturel · Telegram @acreatorstore