Show HN: Minimal dbt-style SQL builds with DuckDB and Make

Summary

Show HN: Minimal dbt-style SQL builds with DuckDB and Make ltrgoddard / duckdb.mk Public Notifications You must be signed in to change notification settings Fork 0 Star 0 Branches Tags Open more actions menu Latest commit History 55 Commits 55 Commits Folders and files Name Name Last commit message Last commit date .github/ workflows .github/ workflows example example test test LICENSE LICENSE README.md README.md REFERENCE.md REFERENCE.md bench.sh bench.sh duckdb.mk duckdb.mk test.sh test.sh Repository files navigation duckdb.mk duckdb.mk is a minimal, highly opinionated build system for local DuckDB projects, inspired by dbt and implemented as a short Makefile. Write interlinked SELECT queries in an organised directory of SQL files; duckdb.mk parses them into a dependency graph using DuckDB's json_serialize_sql function and builds a corresponding directory of Parquet tables.

Why it matters

This ProductUpdate is relevant to the technology intelligence record because it involves GitHub, Meta. The source article should remain the factual reference for follow-up coverage.

Key facts

ltrgoddard / duckdb.mk Public Notifications You must be signed in to change notification settings Fork 0 Star 0 Branches Tags Open more actions menu Latest commit History 55 Commits 55 Commits Folders and files Name Name Last commit message Last commit date .github/ workflows .github/ workflows example example test test LICENSE LICENSE README.md README.md REFERENCE.md REFERENCE.md bench.sh bench.sh duckdb.mk duckdb.mk test.sh test.sh Repository files navigation duckdb.mk duckdb.mk is a minimal, highly opinionated build system for local DuckDB projects, inspired by dbt and implemented as a short Makefile.
Write interlinked SELECT queries in an organised directory of SQL files; duckdb.mk parses them into a dependency graph using DuckDB's json_serialize_sql function and builds a corresponding directory of Parquet tables.
DuckDB and Make are both wonderful 'Swiss army knife' tools -- together, they make it extremely easy to build multi-stage data pipelines querying local and external sources, e.g.
for research or analytical dashboards.
duckdb.mk is a formalisation of an ad hoc approach that I've developed over many years of working on data journalism and research projects at NGOs.
See example/ for a duckdb.mk project that analyses methane emissions using public data and REFERENCE.md for the full interface.

Entities in this story

Companies

GitHub→ Meta→

Related events