mirrors/system-design-primer
1
0
Fork 0
mirror of https://github.com/donnemartin/system-design-primer.git synced 2025-12-15 17:38:56 +03:00
Code Issues Projects Releases Wiki Activity

Merge f6f1c3e5b1 into b02784ffeb

Browse Source
This commit is contained in:
lor-engel
2025-06-22 10:32:43 +08:00
committed by GitHub
parent b02784ffeb f6f1c3e5b1
commit 9a6c4bda3e
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
solutions/system_design/web_crawler/README.md
View File

@@ -159,6 +159,8 @@ class Crawler(object):
...
def crawl_page(self, page):
self.reverse_index_queue.add(page.url)
self.doc_index_queue.add(page.url)
for url in page.child_urls:
self.data_store.add_link_to_crawl(url)
page.signature = self.create_signature(page)