Published on 15 September, 2020
Category :
Programming / Coding
About :
Now let's look at how to systematically catalog or search every page on a site. Crawling an entire site, especially a large one, is a memory-intensive process that is best suited to applications where a database to store crawling results is readily available. We will explore that option in a later video.
