product image

Quarry Pipeline Pack

$50
1 members

Adds orchestration and a real warehouse.

Everything in Local Analytics, plus scheduling and a columnar warehouse.

WHAT YOU GET

Everything in Quarry Local Analytics, plus:

Airflow (Apache-2.0) - the default scheduler for data pipelines. DAGs as Python, with retries, backfills and a UI that shows what actually ran and what failed.

ClickHouse (Apache-2.0) - a columnar OLAP database that aggregates billions of rows in milliseconds. The engine you reach for when queries on a row store stop finishing.

Plus a first-DAG walkthrough: define a pipeline, schedule it, watch it run, read the logs when it does not.

WHY ORCHESTRATION

An unorchestrated pipeline is a cron job nobody can debug. Airflow gives you retries, dependencies and history - which is what you need the first time something fails at 3am.

ALL OPEN SOURCE, ALL PERMISSIVE

Apache-2.0 and MIT. Full attribution with pinned commits included.

REQUIREMENTS

Docker Engine 24+ with Compose v2. 8 GB RAM.

Instant delivery. One-time purchase, free updates.