Focused crawler
id:
focused-crawler-259-11668058
title:
Focused crawler
text:
A focused crawler is a web crawler that collects Web pages that satisfy some specific property, by carefully prioritizing the crawl frontier and managing the hyperlink exploration process. Some predicates may be based on simple, deterministic and surface properties. For example, a crawler's mission may be to crawl pages from only the .jp domain. Other predicates may be softer or comparative, e.g., "crawl pages about baseball", or "crawl pages with large PageRank". An important page property pert
brand slug:
wiki
category slug:
encyclopedia
description:
Type of web crawler
original url:
https://en.wikipedia.org/wiki/Focused_crawler
date created:
date modified:
2023-05-17T20:09:01Z
main entity:
{"identifier":"Q5463958","url":"https://www.wikidata.org/entity/Q5463958"}
image:
fields total:
13
integrity:
14