skylv-data-pipeline-builder

by sky-lv

Install this Skill

curl -fsSL -o skylv-data-pipeline-builder.zip https://skill.seembox.com/api/v1/skills/skylv-data-pipeline-builder/download && unzip skylv-data-pipeline-builder.zip

Download skylv-data-pipeline-builder.zip

SKILL.md About

# data-pipeline-builder

Build and manage ETL/data pipelines for AI agents. Extract, transform, load data between databases, APIs, and file systems.

## Overview

A skill for creating and managing data pipelines that move and transform data across different sources and destinations.

## Features

- **Source Connectors**: Connect to databases, APIs, files, S3, GCS
- **Data Transformation**: Apply filters, mappings, aggregations
- **Scheduling**: Cron-based or event-triggered pipelines
- **Error Handling**: Retry logic, dead letter queues
- **Data Validation**: Schema validation, data quality checks
- **Monitoring**: Pipeline status, throughput, error rates
- **Incremental Sync**: Support for CDC (Change Data Capture)

## Commands

### Create Pipeline

```
create pipeline from mysql to postgres
```

### Run Pipeline

```
run etl-job daily-sales-report
```

### Monitor Pipeline

```
check pipeline health
```

## Use Cases

- Database synchronization
- API data extraction
- File processing and conversion
- Data warehousing
- Report generation
- Analytics data preparation

## Requirements

- Node.js 18+
- Python 3.8+ (for data processing)
- Source/destination connectors as needed

_meta.json Metadata

{
  "ownerId": "kn7c4d4r1tezx1t4dxm5mh62rn84f02r",
  "publishedAt": 1777682980998,
  "slug": "skylv-data-pipeline-builder",
  "version": "1.0.0"
}