AWS Glue is offered as a code-based, non-server reliant ETL option in contrast to typical drag-and-drop platforms, mainly implemented by Amazon ecosystem users. Seeing as Glue comes with brand new features as compared to orthodox tooling it is no surprise that it is often set in competition with Apache Airflow, especially by members with...
Airflow is an open-source task time-tabler that enables users to programmatically write, construct, inspect and distribute workflows on the cloud. It is a crowd-sourced software that has been around for that past seven years, originally developed by the data team at Airbnb and donated the Apache foundation. While there are alternative more commercial options available...
Let’s begin by talking about Airflow. In a nutshell it is a platform to programmatically write, timetable and oversee workflows. You can use airflow to author workflows as Directed Acyclic Graphs (DAGs) of tasks. Simplifying this further Airflow assists in automating scripts so that it can execute operations. It is founded in Python however...
