dbt

dbt (data build tool) is an open-source framework that lets data analysts and data engineers transform data directly in the data warehouse using SQL, while applying software-engineering best practices: Git versioning, tests, documentation, modularity and CI/CD.

A dbt project consists of models (versioned SQL files), tests (assertions on the data), sources (references to raw tables) and macros (Jinja). At runtime, dbt compiles everything into native SQL and executes it on Snowflake, BigQuery, Redshift, Databricks or Postgres.

dbt has become the de-facto standard of the modern data stack, around which much of the analytics engineer role is organised.