An Introduction to Spark

Description

In this course, you will learn :

• Basics of Spark
• Spark Architecture
• Spark SQL
• Spark DataFrames
• Spark Datasets

Syllabus :

1. Spark Overview

• Spark Differentiation
• Architecture
• Spark Application Lifecycle
• Spark API
• Anatomy of a Spark Application
• Execution of a Spark Application
• Resilient Distributed Datasets
• Spark Application - An Example

 

2. DataFrames

• DataFrames
• Working with DataFrames
• Columns
• Rows
• More Operations with DataFrames

 

3. Datasets

• Datasets
• Working with Datasets
• Datasets with Scala Case Class and Java Bean Class
• Encoders

 

4. Spark SQL

• Spark SQL Engine
• Spark SQL - An Example
• Spark SQL Views and Tables
• Spark SQL Data Source
• Spark User Defined Functions
• Higher-Order Function
• Joins, Unions, and Window Functions

Show more