Data Pipeline Toolkit

# Data Pipeline Toolkit

Safety Notice

This listing is from the official public ClawHub registry. Review SKILL.md and referenced scripts before running.

Copy this and send it to your AI assistant to learn

Install skill "Data Pipeline Toolkit" with this command: npx skills add sunshine-del-ux/data-pipeline-toolkit

Data Pipeline Toolkit

Build ETL pipelines in minutes.

Features

  • Extract - APIs, databases, files, streams
  • Transform - Clean, filter, aggregate, join
  • Load - Data warehouses, databases, APIs
  • Scheduling - Cron-based or event-driven
  • Monitoring - Alerts on failures

Quick Start

# Create pipeline
./pipeline.sh create my-pipeline

# Add extract step
./pipeline.sh extract my-pipeline api --url https://api.example.com

# Add transform
./pipeline.sh transform my-pipeline filter "age > 18"

# Add load
./pipeline.sh load my-pipeline postgres --connection $DB_URL

# Run
./pipeline.sh run my-pipeline

Sources

  • REST APIs
  • GraphQL
  • SQL Databases
  • CSV/JSON/Parquet files
  • S3/Google Cloud Storage
  • Kafka/SQS

Destinations

  • PostgreSQL/MySQL
  • Snowflake/BigQuery
  • S3
  • APIs
  • Data warehouses

Requirements

  • Python 3.8+
  • Docker (optional)

Author

Sunshine-del-ux

Source Transparency

This detail page is rendered from real SKILL.md content. Trust labels are metadata-based hints, not a safety guarantee.

Open Registry RecordOpen in ClawHub

Related Skills

Related by shared tags or category signals.

General

ksdsl-skilll

Captures learnings, errors, and corrections to enable continuous improvement. Use when: (1) A command or operation fails unexpectedly, (2) User corrects Clau...

Registry SourceRecently Updated
3640f1zzyw
General

Openclaw Skill Intelligence Ingestion

Auto-analyze URLs/info for OpenClaw strategic value, classify, create Obsidian notes, update memory. Use when user shares a URL, article, tweet, or any exter...

Registry SourceRecently Updated
55902233admin
General

Truth first

Evidence-first verification for status, config, file contents, actions, connectivity, mounts, and model selection. Use before answering any such claim.

Registry SourceRecently Updated
3480royhk920
General

http-retry

Automatically retries HTTP requests with exponential backoff, timeout control, and connection pooling to handle network errors and rate limits.

Registry SourceRecently Updated
82702233admin