NOTE: We recently gave an Airflow at WePay talk to the Bay Area Airflow meetup group. The video and slides are both available. Our last post provided an overview of WePay’s data warehouse. In this post, we’ll be diving into how we run Airflow as part of the ETL pipeline. Introduction Airflow is a workflow scheduler. It lets you define a series of tasks (chunks of code, queries, etc) that can be st
