layouts/pipeline.md
GitHubPipeline Layout
Layout: Horizontal left-to-right flow with sequential stages Best for: Data pipelines, CI/CD flows, ETL processes, horizontal stage-based flows
Template
Data Pipeline Architecture
Ingest
API Collectors
Event Stream
File Upload
CDC Capture
→
Process
Stream Engine
Validation
Enrichment
Deduplication
→
Transform
Schema Mapping
Aggregation
Normalization
Feature Eng.
→
Store
Data Lake
Data Warehouse
Search Index
Cache
→
Serve
REST API
BI Dashboard
ML Models
Reports