Claude Code Skills·Claude Skills·The open SKILL.md registry for Claude
ClaudSkills / Dev Tools / tools-misc

Firehose Iceberg Pipeline

Category: Dev Tools  ·  Sub-category: tools-misc  ·  Last updated:
cloud:aws
Build an Amazon Data Firehose delivery stream that writes to Apache Iceberg tables on S3 Tables via IcebergDestinationConfiguration. Covers the column-shape footgun (records land in the error bucket with Iceberg.MissingColumnWithinRecord unless a transform Lambda reshapes them), the microsecond timestamp requirement, the three-phase deploy pattern that works around Firehose's synchronous glue:GetTable validation at create time, parameter-inheritance traps in `aws cloudformation deploy`, Lake Formation grant ordering, and how to decode the error bucket. Use when you see "Firehose to Iceberg", "Firehose to S3 Tables", "IcebergDestinationConfiguration", "Firehose data transformation Lambda", "Firehose error bucket", "Iceberg.MissingColumnWithinRecord", "MissingColumnWithinRecord", or any time someone is wiring a Kinesis Data Stream / Direct PUT source to Iceberg tables and producer record shape does not match the Iceberg column layout.

About this skill (catalog notes)

Firehose Iceberg Pipeline includes explicit scope boundaries (an explicit 'when not to use' or 'out of scope' section); worked examples; 18 code blocks for direct copy-paste. At roughly 2,513 words the SKILL.md is on the longer end of the catalog distribution.

Source
github.com/jaingxyz/dsql-redshift-cdc-pipeline
License
AGPL-3.0
Original author
jaingxyz
Indexed lastmod
Catalog position
Dev Tools · tools-misc
Indexed related skills
10

How Firehose Iceberg Pipeline fits the catalog

Firehose Iceberg Pipeline sits in the Dev Tools category under the tools-misc sub-topic in the ClaudSkills catalog. There are 10 related skills indexed alongside it; comparing a few before installing usually reveals which fits your workflow best.

These notes are auto-generated from features detected in the SKILL.md file and from this catalog's structure — they aren't part of the source repository.

From the source SKILL.md

Specialty skill for one architecture choice: Amazon Data Firehose with IcebergDestinationConfiguration writing to Apache Iceberg tables on S3 Tables, with optional reshape via a transform Lambda.

What this skill does

Firehose Iceberg Pipeline is a community-contributed Claude Code skill in the tools-misc sub-category. It ships as a SKILL.md file that Claude Code auto-discovers under ~/.claude/skills/firehose-iceberg-pipeline/ and loads when your prompt matches the skill's trigger.

When to invoke it: Use when you see "Firehose to Iceberg", "Firehose to S3 Tables", "IcebergDestinationConfiguration", "Firehose data transformation Lambda", "Firehose error bucket", "Iceberg.MissingColumnWithinRecord", "MissingColumnWithinRecord", or any time someone is wiring a Kinesis Data Stream / Direct PUT source to Iceberg tables and producer record shape does not match the Iceberg column layout.

Who uses this skill

The Firehose Iceberg Pipeline Claude Code skill is built for developers, power users, and teams automating repetitive workflows and improving developer experience. It's part of ClaudSkills (also referred to as Claude Skills or Claude Code Skills) — the open community-curated registry of 116,000+ SKILL.md files for Anthropic's Claude Code agent and the wider Claude ecosystem (Claude API, Claude Agent SDK).

How to install

Free

Manual install (2 steps)

mkdir -p ~/.claude/skills/firehose-iceberg-pipeline
curl -L https://claudskills.com/skills/firehose-iceberg-pipeline/SKILL.md \
  -o ~/.claude/skills/firehose-iceberg-pipeline/SKILL.md

Or just download SKILL.md directly and drop it into ~/.claude/skills/firehose-iceberg-pipeline/. Claude Code auto-discovers it on next session.

Skills live at ~/.claude/skills/firehose-iceberg-pipeline/SKILL.md on macOS/Linux, or %USERPROFILE%\.claude\skills\firehose-iceberg-pipeline\SKILL.md on Windows. See the full install guide for step-by-step instructions.

Telegram

📱 Install from your phone or desktop Telegram

Open @claudskills_bot on Telegram, tap Open Desktop App, and the desktop app installs this skill for you. Or share the bot link with a colleague — they get the same one-tap install. Learn more →

Pro

One-click install via the desktop app

The ClaudSkills desktop app installs any skill directly into ~/.claude/skills/ with one click — no terminal required. Pro starts at $9/mo or $149 lifetime.

Pro

For the full experience including quality scoring and one-click install features for each skill — upgrade to Pro.

Frequently asked questions

How do I install the Firehose Iceberg Pipeline Claude Code skill?
Install via the ClaudSkills desktop app (one click) or copy SKILL.md from the source repository to ~/.claude/skills/firehose-iceberg-pipeline/SKILL.md and restart Claude Code. Both flows are detailed at claudskills.com/install/.
What does the Firehose Iceberg Pipeline skill do?
Build an Amazon Data Firehose delivery stream that writes to Apache Iceberg tables on S3 Tables via IcebergDestinationConfiguration. Covers the column-shape footgun (records land in the error bucket with Iceberg.MissingColumnWithinRecord unless a transform Lambda reshapes them), the microsecond timestamp requirement, the three-phase deploy pattern that works around Firehose's synchronous glue:GetTable validation at create time, parameter-inheritance traps in `aws cloudformation deploy`, Lake Formation grant ordering, and how to decode the error bucket. Use when you see "Firehose to Iceberg", "Firehose to S3 Tables", "IcebergDestinationConfiguration", "Firehose data transformation Lambda", "Firehose error bucket", "Iceberg.MissingColumnWithinRecord", "MissingColumnWithinRecord", or any time someone is wiring a Kinesis Data Stream / Direct PUT source to Iceberg tables and producer record shape does not match the Iceberg column layout.
Is this skill free to install?
Yes. ClaudSkills is an open registry — every skill keeps its source repository's license, and manual install via copy is free. ClaudSkills Pro ($9/mo, $79/yr, or $149 one-time) adds one-click install via the desktop app and a multi-signal Quality Score.
When should I use the Firehose Iceberg Pipeline skill?
Use Firehose Iceberg Pipeline when your Claude Code task falls under the Dev Tools category — specifically in the tools misc area. Claude Code auto-discovers installed skills and invokes the right one based on the task description, so you can also ask Claude directly (e.g. "use Firehose Iceberg Pipeline" or describe the task and let Claude pick). Browse related skills at /category/tools/.
What is a Claude Code skill and how does the Firehose Iceberg Pipeline skill fit in?
A Claude Code skill is a SKILL.md file that lives under ~/.claude/skills/<name>/ and tells the Claude Code CLI agent how to perform a specific task (instructions, prompts, allowed tools). Skills are auto-discovered at session start. Firehose Iceberg Pipeline is one of 67,000+ skills indexed in the open ClaudSkills catalog, classified under the Dev Tools category. Learn more at /learn/what-is-a-claude-skill/.

Attribution & license

Cite this skill

If you reference this skill in a blog post, paper, or documentation, you can cite it as:

APA
jaingxyz. (2026). Firehose Iceberg Pipeline [Claude Code skill]. ClaudSkills. https://claudskills.com/skills/firehose-iceberg-pipeline/
BibTeX
@misc{firehose-iceberg-pipeline-2026,
  author    = {jaingxyz},
  title     = {Firehose Iceberg Pipeline [Claude Code skill]},
  year      = {2026},
  publisher = {ClaudSkills},
  url       = {https://claudskills.com/skills/firehose-iceberg-pipeline/}
}

Embed this skill

Promote, attribute, or link this skill from your own README, blog post, or documentation. All three snippets are free to use — no sign-up, no API key. More distribution surfaces →

Badge
[![ClaudSkills](https://claudskills.com/badge/firehose-iceberg-pipeline.svg)](https://claudskills.com/skills/firehose-iceberg-pipeline/?utm_source=badge&utm_medium=readme&utm_campaign=skill_badge)
<script>
<script src="https://claudskills.com/embed/firehose-iceberg-pipeline.js" async></script>
<iframe>
<iframe src="https://claudskills.com/embed/firehose-iceberg-pipeline.html" width="100%" height="160" frameborder="0" loading="lazy" title="ClaudSkills: Firehose Iceberg Pipeline"></iframe>

Free. No spam. Unsubscribe in one click.

More Dev Tools skills

Browse all Dev Tools skills in the ClaudSkills registry, or explore these other picks from the same category:

Browse all Dev Tools skills → Top 100 skills
Part of ClaudSkills — the open registry for Claude Skills & Claude Code Skills.  ·  What's New  ·  Install guide  ·  About  ·  llms.txt

Part of Acreator Store — Adam Lankamer's AI tools: PerfectStudio · Ucaption · UTagger · AutoXPoster · TestYourSkills · AutomationFlows · Au Naturel · Telegram @acreatorstore