机械主题爬虫的设计与实现

由于通用搜索引擎检索返回的结果过多、主题相关性不强以及随着人们对提供的各项信息服务的要求越来越高、越来越细,基于整个Web的信息采集越来越力不从心。同时它也无法迅速地搜集到足够的最新的网络信息,也不能满足人们日益增长的个性化需求。本文希望通过开发一个机械类主题方面的爬虫以满足用户专门检索机械类信息的要求。

Design and Implementation of a Machine Focused Web Crawler

The popularity of Web has been growing rapidly in the last few years.However,faced with people's requirements more and more rigorous and prolific,general search engine still can't satisfy personal need accurately.Based on the entire Web Information Collection increasingly powerless.It also failed to promptly collect enough of the latest network information,and it can not meet the people's increasing demand for personalized.This paper hopes to develop a mechanical type of reptile theme specifically to meet user information retrieval machinery category requirements.