Building Smarter Data Pipelines: SQL, Spark, Kafka & GenAI
Coursera
Master the complete data engineering pipeline from ingestion to analytics. Learn to build scalable data systems using Apache Kafka, Spark, and cloud platforms while integrating cutting-edge generative AI technologies.
About this Course
Master the complete data engineering pipeline from ingestion to analytics. Learn to build scalable data systems using Apache Kafka, Spark, and cloud platforms while integrating cutting-edge generative AI technologies. Apply your skills through hands-on projects that mirror real-world data engineering challenges in modern enterprises
What You'll Learn
- Design and implement scalable data ingestion, processing, and storage systems using Apache Kafka and Spark
- Build high-performance data pipelines integrating cloud platforms, databases, and generative AI technologies
- Apply data engineering best practices for enterprise-scale analytics, optimization, and real-time processing
Prerequisites
- Basic familiarity with the topic and its common terminology
- Readiness to practice through applied exercises or case-based work
Instructors
Caio Avelino
Data Science, Business Intelligence, Machine Learning
Starweaver
Global Leaders in Professional & Technology Education
Soheil Haddadi
Data Scientist | AI & ML Research Scientist | Interested in LLMs and GenAI
Karlis Zars
Computer Science Ph.D., Trainer and Consultant