Master Control Module-Introduction to PCI+Express Architecture
5.5 Master Control Module is responsible for interacting with the user and scheduling other modules to complete tasks according to user commands. Because synchronizing nodes in the cluster is difficult when adding records to the Bloom filter, the Master Control Module is responsible for adding the crawled URLs into the Bloom filter for the Crawled URL Deduplication Module to identify duplicates. See Figure 5-5.
2.31MB
文件大小:
评论区