Data Pipeline Design
botdocs install @botdocs/data-pipeline-designautomationv1
Data Pipeline Design
A specification for building data pipelines covering ingestion, transformation, validation, loading, and monitoring.
Updated yesterday
─── paste into your agent
─── or use the CLI
Drops the skill into Claude, Cursor, Codex, or ChatGPT — auto-detects what you have installed.
0 installs
Data Pipeline Design
A specification for building reliable data pipelines.
Pipeline Stages
Source → Extract → Validate → Transform → Load → Monitor
Design Principles
- Idempotent — Running the same pipeline twice produces the same result
- Observable — Every stage emits metrics and logs
- Recoverable — Failed stages can be retried without reprocessing everything
- Testable — Each stage can be tested in isolation with sample data
Stage Details
─── preview
Sign in to read the full skill.
You're viewing a preview — sign in to see the rest of this skill and copy or install it.