Heads up! To view this whole video, sign in with your Courses account or enroll in your free 7-day trial. Sign In Enroll
Well done!
You have completed Scraping Data From the Web!
You have completed Scraping Data From the Web!
Preview
We've seen how to scrape data from a single page. Now let's see how we can capture links on one page and follow them to process additional pages.
Additional Resources
- Regular Expressions in Python
Related Discussions
Have questions about this video? Start a discussion with the community and Treehouse staff.
Sign upRelated Discussions
Have questions about this video? Start a discussion with the community and Treehouse staff.
Sign up
isolate all the links on that page.
0:00
We can utilize that and
start moving off a single page and
0:01
onto multiple pages, or crawling the web.
0:04
The internet constitutes over 4.5 billion
pages connected together with hyperlinks.
0:07
Web crawling is, for our purposes, the
practice of moving between these connected
0:14
web pages and
crawling along the paths of hyperlinks.
0:19
This is where the power of
automation comes into play.
0:22
We can write our application to
look at a page, scrape the data,
0:25
then follow the links, if any, on that
page and scrape the next page, and so on.
0:29
You need to sign up for Treehouse in order to download course files.
Sign upYou need to sign up for Treehouse in order to set up Workspace
Sign up