Modern Web Scraping Fundamentals with Python

Description

In this course, you will :

• Learn about the most important aspects of web scraping.
• Construct their own web scraping projects.
• Discover the fundamentals of two of the most powerful scraping libraries, Scrapy and BeautifulSoup.
• Create a number of hands-on projects.

Syllabus :

1. Getting Started!

• Simple HTTP Request
• What is a website + the DOM
• Sublime
• The Inspector
• Traversing The Tree
• Robots.txt
• Anaconda Update Notice
• Anaconda Download
• Setting up your virtual environment

 

2. Scrapy Challenge

• Introduction and Installing Scrapy
• Starting your Scrapy Project
• Building your first Spider
• Scrapy Shell
• Note for Scrapy
• Scrapy Shell Update
• Selectors
• Scrapy Items
• Request + Response
• Traversing Options
• Challenge Intro
• Challenge Solution
• Quick Note!
• Scrapy Cloud

 

3. BeautifulSoup Challenge

• BS Installation
• BS Requests
• BS Basics
• BS Basics cont.
• BS Challenge Intro
• BS Challenge Solution

 

4. Selenium + BeautifulSoup

• GitHub
• Section Intro + Selenium Installation
• Resources for Selenium
• Selenium Notes
• Selenium - Click Revised
• Selenium Login Keys
• Selenium Challenge Intro
• Recommended: Build Your Own Approach First
• Selenium Challenge Pt. 1
• Selenium Challenge Solution
• Selenium Project Feedback

Show more