CDN加速镜像 | 设为首页 | 加入收藏夹
登陆 | 会员注册
当前位置： 首页 资源下载 源码下载 Internet/网络编程 搜索引擎
收藏

文件名称:crawler-1.0-sources

  • 所属分类：
    Search Engine
  • 标签属性：
    [Java] [源码]
  • 上传时间：
    2013-05-21
  • 文件大小：
    24.25kb
  • 已下载：
    0次
  • 提 供 者：
    c*****
  • 相关连接：
    无
  • 下载说明：
    别用迅雷下载，失败请重下，重下不扣分！
修正介绍说明

介绍说明－－下载内容来自于网络，使用问题请自行百度

网络蜘蛛是通过网页的链接地址来寻找网页



网络蜘蛛

，从网站某一个页面（通常是首页）开始，读取网页的内容，找到在网页中的其它链接地址，然后通过这些链接地址寻找下一个网页，这样一直循环下去，直到把这个网站所有的网页都抓取完为止。如果把整个互联网当成一个网站，那么网络蜘蛛就可以用这个原理把互联网上所有的网页都抓取下来。

----这样看来，网络蜘蛛就是一个爬行程序，一个抓取网页的程序-internet crawler
(系统自动生成,下载前可以参看下载内容)

下载文件列表

crawler-1.0-sources/
crawler-1.0-sources/META-INF/
crawler-1.0-sources/META-INF/MANIFEST.MF
crawler-1.0-sources/net/
crawler-1.0-sources/net/vidageek/
crawler-1.0-sources/net/vidageek/crawler/
crawler-1.0-sources/net/vidageek/crawler/component/
crawler-1.0-sources/net/vidageek/crawler/component/DefaultLinkNormalizer.java
crawler-1.0-sources/net/vidageek/crawler/component/Downloader.java
crawler-1.0-sources/net/vidageek/crawler/component/ExecutorCounter.java
crawler-1.0-sources/net/vidageek/crawler/component/LinkNormalizer.java
crawler-1.0-sources/net/vidageek/crawler/component/PageCrawlerExecutor.java
crawler-1.0-sources/net/vidageek/crawler/component/UrlUtils.java
crawler-1.0-sources/net/vidageek/crawler/component/WebDownloader.java
crawler-1.0-sources/net/vidageek/crawler/config/
crawler-1.0-sources/net/vidageek/crawler/config/CrawlerConfiguration.java
crawler-1.0-sources/net/vidageek/crawler/config/CrawlerConfigurationBuilder.java
crawler-1.0-sources/net/vidageek/crawler/config/http/
crawler-1.0-sources/net/vidageek/crawler/config/http/Cookie.java
crawler-1.0-sources/net/vidageek/crawler/ContentVisitor.java
crawler-1.0-sources/net/vidageek/crawler/exception/
crawler-1.0-sources/net/vidageek/crawler/exception/CrawlerException.java
crawler-1.0-sources/net/vidageek/crawler/link/
crawler-1.0-sources/net/vidageek/crawler/LinksFinder.java
crawler-1.0-sources/net/vidageek/crawler/link/DefaultLinkFinder.java
crawler-1.0-sources/net/vidageek/crawler/link/FrameLinkFinder.java
crawler-1.0-sources/net/vidageek/crawler/link/IframeLinkFinder.java
crawler-1.0-sources/net/vidageek/crawler/page/
crawler-1.0-sources/net/vidageek/crawler/Page.java
crawler-1.0-sources/net/vidageek/crawler/PageCrawler.java
crawler-1.0-sources/net/vidageek/crawler/PageVisitor.java
crawler-1.0-sources/net/vidageek/crawler/page/ErrorPage.java
crawler-1.0-sources/net/vidageek/crawler/page/OkPage.java
crawler-1.0-sources/net/vidageek/crawler/page/RejectedMimeTypePage.java
crawler-1.0-sources/net/vidageek/crawler/queue/
crawler-1.0-sources/net/vidageek/crawler/queue/DelayedBlockingQueue.java
crawler-1.0-sources/net/vidageek/crawler/Status.java
crawler-1.0-sources/net/vidageek/crawler/Url.java
crawler-1.0-sources/net/vidageek/crawler/visitor/
crawler-1.0-sources/net/vidageek/crawler/visitor/DoesNotFollowVisitedUrlVisitor.java
crawler-1.0-sources/net/vidageek/crawler/visitor/DomainVisitor.java
crawler-1.0-sources/net/vidageek/crawler/visitor/RejectAtDepthVisitor.java

相关说明

  • 本站资源为会员上传分享交流与学习,如有侵犯您的权益,请联系我们删除.
  • 搜珍网是交换下载平台，只提供交流渠道，下载内容来自于网络，除下载问题外，其它问题请自行百度。更多...
  • 本站已设置防盗链，请勿用迅雷、QQ旋风等下载软件下载资源，下载后用WinRAR最新版进行解压.
  • 如果您发现内容无法下载，请稍后再次尝试；或换浏览器；或者到消费记录里找到下载记录反馈给我们.
  • 下载后发现下载的内容跟说明不相乎，请到消费记录里找到下载记录反馈给我们，经确认后退回积分.
  • 如下载前有疑问，可以通过点击"提供者"的名字，查看对方的联系方式，联系对方咨询.
查看所有评论

相关评论

暂无评论内容．

发表评论

*快速评论： 推荐 一般 有密码 和说明不符 不是源码或资料 文件不全 不能解压 纯粹是垃圾
*内　　容：
*验 证 码：
搜珍网 www.dssz.com

浏览历史记录

关闭