Description
In this course, you will:
- Discover what data engineering is and why demand for it is growing.
- Discover where data engineering fits into the data science lifecycle, how data engineers differ from data scientists, and get an introduction to your first entire data pipeline.
- Learn how data engineers manage various data structures, employ SQL—the preferred programming language for searching and storing data—and design optimal data storage solutions using data lakes and data warehouses.
- Data engineers make data scientists' lives easier by preparing raw data for analysis at various stages, employing diverse processing techniques.
- These processes must be connected to form pipelines, which is where automation comes into play. Finally, data engineers employ parallel and cloud computing to ensure pipelines run properly.
Syllabus:
- What is data engineering?
- Storing data
- Moving and processing data