ETL and Data Pipelines with Shell, Airflow and Kafka

Delve into the two different approaches to converting raw data into analytics-ready data. One approach is the Extract, Transform, Load (ETL) process. The other contrasting approach is the Extract, Load, and Transform (ELT) process. ETL processes apply to data warehouses and data marts. ELT processes apply to data lakes, where the data is transformed on demand by the requesting/calling application. In this course, you will learn about the different tools and techniques that are used with ETL a

• Describe and contrast Extract, Transform, Load (ETL) processes and Extract, Load, Transform (ELT) processes.
• Explain batch vs concurrent modes of execution.
• Implement ETL workflow through bash and Python functions.
• Describe data pipeline components, processes, tools, and technologies.