Leveraging all we learned previously, we will build an extremely fast web crawler to help us find the needles in the haystack the web is.
What is the purpose of building an extremely fast web crawler?
1) To gather information from the web
2) To create a search engine
3) To improve website performance
4) To protect against cyber attacks