I walk through setting up Apache Airflow to use Dask.distributed, PostgreSQL, logging to AWS S3 as well as create User accounts and Plugins.
Category: Airflow | All Categories
A guide to running Airflow and Jupyter Notebook with Hadoop 3, Spark & Presto.
I walk through setting up a data pipeline for currency exchange rates using Airflow, PostgreSQL and Redis.
Copyright © 2014 - 2017 Mark Litwintschik. This site's template is based off a template by Giulio Fidente.