Extract all the data! - 02 - Python scrapy tutorial for beginners

In our last lesson, we have created our first Scrapy spider and we have scraped a few fields from the book. But we also learnt that every item has a URL with more detailed data. Let’s see how to extract all the data in different ways.

In this post you will learn how to:

Scrap items on their own page
Extract routes with relative URLs
Select elements by tag, class, partial class and siblings elements
Extract information from tables
Use callbacks to other Scrapy class methods

---------------------------------

Timestamps:

00:38 - Gameplan
01:00 - Creating a new method
03:25 - Extracting the first elements
06:45 - The 'contains' selector
12:34 - The 'following-sibling' selector
14:04 - Selecting tables
16:56 - Conclusion

---------------------------------

Related videos:

Beautiful Soup - 01 - Your first Web Scraping script with Python
https://www.youtube.com/watch?v=HIjejEdPr3I

Creating your first Scrapy spider - 01 - Python scrapy tutorial for beginners
https://www.youtube.com/watch?v=gGnGnIPgR84

---------------------------------

Subscribe to the channel:
https://www.youtube.com/channel/UC9OLm6YFRzr4yjlw4xNWYvg?sub_confirmation=1

Text version:
https://letslearnabout.net/tutorial/scrapy-tutorial/python-scrapy-tutorial-for-beginners-02-extract-all-the-data

Twitter:
https://twitter.com/DavidMM1707

GitHub:
https://github.com/david1707