Tutsplus - Crawl the Web With Python

English | Duration: 1h | .MP4 | h264, yuv420p, 960x600, 25.00 fps(r)| aac, 48000 Hz, mono | 330 MB

Genre: E-learning

In a recent business venture, I found it necessary to collect bulk data from different online sources in order to centralize it and make it easier for people to find and to make sense of. None of those sites had exposed public APIs, so I decided to try my hand at a little web crawling and scraping to obtain this metadata. After searching around for a while, I found that many people when faced with the same issue have turned to Python. After all, if it was good enough for Google, it's definitely good enough for me!

In this course I will share some of my findings and show you how you can go about creating your own basic web crawler and scraper.