#67 Airflow (part 3): Conditional tasks by weekday

Linear Pipeline

Also known as static pipeline, it performs fixed functions and later they are linked together. However, the drawback is that each task will be executed linearly, not sequentially or in other words, one after another. There are certain situation where we need to go beyond this pipeline design, for instance some tasks are conditioned by the result of execution of other tasks. This is when we need to put dynamic pipeline into action.

Dynamic pipeline

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store