Posted on

The Pros and Cons of Airflow Against AWS Glue

AWS Glue is offered as a code-based, non-server reliant ETL option in contrast to typical drag-and-drop platforms, mainly implemented by Amazon ecosystem users. Seeing as Glue comes with brand new features as compared to orthodox tooling it is no surprise that it is often set in competition with Apache Airflow, especially by members with a preference for code based ETL tools that are flexible. Continue reading “The Pros and Cons of Airflow Against AWS Glue”
Working with Apache Airflow
Posted on

Working with Apache Airflow

Let’s begin by talking about Airflow. In a nutshell it is a platform to programmatically write, timetable and oversee workflows. You can use airflow to author workflows as Directed Acyclic Graphs (DAGs) of tasks. Simplifying this further Airflow assists in automating scripts so that it can execute operations. It is founded in Python however you can run a program on it regardless of its coding language. Continue reading “Working with Apache Airflow”