Scraping Dynamic Web Pages with Python and Selenium

Description

In this course, you will :

• Learn how to identify and locate dynamic elements on a website before handing over the page source to beautiful soup.
• Investigate the common challenges you will face as well as methods to improve scraping efficiency.
• be able to extract data from any dynamic webpage using Python, Selenium, and Beautiful Soup

Syllabus:

1. Exploring Selenium with Python

•  Overview of Scraping Dynamic Webpages 
•  What Is Selenium and Where Is It Used? 
•  Selenium WebDriver 

 

2. Locating Elements & Navigating Dynamic Web Pages

• Introduction to Elements 
• Methods to Locate Elements 

 

3. Loading Selenium Page Source into BeautifulSoup

• Introduction to Beautiful Soup 
• Transitioning from Selenium to Beautiful Soup 

 

4. Overcoming Challenges and Increasing Efficiency

•  Challenges in Web Scraping 
•  Tips to Increase Efficiency & Best Practices 

Show more