This page is for testing purposes, it is the demo page used on the Python Programming for Computer Science beginner course.
It includes many links that the web crawler that we’re programming in the course should crawl.
This is an exemple of links sending the visitor to ‘course description‘ page.
We won’t need to worry about paragraphs, grammar, and writing style, what’s important here is to find the links like this one linking to the ‘Python Projects For Beginners‘ page.
Although the content quality, writing style, and many other factors are important for SEO to get the page ranked higher in SERP, we’re not going to focus on that as this is a Python Programming For Computer Science course, but not an SEO course.
By the end of Unit 1, your crawler should be able to find and extract all the links on this page.
Watch all the videos of this unit and more on YouTube
For the purpose of having a clear understanding of what needs to be done and how are we going to do it on this Python for Computer Science course, I’ve attached live coding demo videos of the finished crawler with the page source code and crawl.py app
Download Test Page in HTML
Download Crawl.py